00000001:02000400:2.0F:1788390247.309816:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788390256.385096:0:3163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788390257.399750:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1095 MB/s 00000001:01000000:2.0:1788390257.650101:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1470 MB/s 00000001:01000000:2.0:1788390257.900081:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9819 MB/s 00000020:02000000:2.0:1788390258.355795:0:3254:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g4d1530a 00000400:02000000:1.0F:1788390258.753401:0:3269:0:(api-ni.c:2824:lnet_startup_lndni()) Added LNI 192.168.202.101@tcp [8/256/0/180] 00008000:02000000:2.0:1788390261.236095:0:3419:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788390282.731636:0:5224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788390287.795762:0:5788:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390287.795767:0:5788:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788390287.795884:0:5788:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e06e2398 00000080:02000400:1.0:1788390287.795892:0:5788:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788390287.801353:0:5788:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788390287.801366:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390287.801418:0:5788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c8a281c2) 00000020:00000080:1.0:1788390287.801449:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0F:1788390287.820578:0:5788:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788390287.821012:0:5788:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788390287.835504:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788390287.835534:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788390287.835548:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788390287.835584:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788390287.835602:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788390287.835991:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788390287.835999:0:5788:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788390287.836010:0:5788:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd319a4 00000020:01000004:2.0:1788390287.836018:0:5788:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788390287.836023:0:5788:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788390287.836028:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e06e2398 from MGS 00000020:01000004:2.0:1788390287.836032:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788390287.836050:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b9775068) 00000020:00000080:2.0:1788390287.836062:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788390287.836175:0:5788:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e06e2398 from MGS, refs=2 00080000:01000000:2.0:1788390287.836181:0:5788:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788390287.836186:0:5788:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd319b2 00000100:00100000:2.0:1788390287.836273:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788390287.837645:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788390287.837656:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788390287.838214:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788390287.838221:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788390287.838751:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390287.838870:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788390287.838873:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788390287.839297:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788390287.839302:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788390287.839544:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788390287.839548:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788390287.839985:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390287.839988:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390287.839989:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390287.840214:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390287.840217:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390287.840218:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390287.840637:0:5788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788390287.843264:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788390288.090042:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6439 MB/s 00000001:01000000:3.0:1788390288.340073:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7547 MB/s 00000001:01000000:1.0:1788390288.590513:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 955 MB/s 00000001:01000000:1.0:1788390288.840418:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1799 MB/s 00010000:00010000:3.0:1788390288.845111:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788390288.845261:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788390288.858384:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788390288.858396:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788390288.858398:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788390288.859012:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788390288.859075:0:5788:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788390288.859123:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788390288.859317:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788390288.859341:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788390288.859668:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.859832:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788390288.859838:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788390288.860841:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788390288.860850:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788390288.861194:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788390288.861202:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788390288.864180:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:0.0:1788390288.864180:0:5802:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788390288.864205:0:5788:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:3.0:1788390288.864207:0:5788:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788390288.864264:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:3.0:1788390288.864282:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (00000000a59ed924) 00000020:00000080:3.0:1788390288.864297:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788390288.864401:0:5788:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006fc99cc8@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390288.864599:0:5788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:3.0:1788390288.864607:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788390288.865708:0:5803:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788390288.865758:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9) 00000020:00000080:1.0:1788390288.865776:0:5788:0:(genops.c:1385:class_connect()) connect: client 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9, cookie 0x9aafc5f04cd319c0 00000100:00080000:1.0:1788390288.865787:0:5788:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390288.865792:0:5788:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import 000000006fc99cc8 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390288.865847:0:5788:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000018871e47 x1875263103172736/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390288.865872:0:5788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9->MGS 00000020:01000004:1.0:1788390288.865890:0:5788:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788390288.865894:0:5788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788390288.865905:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000040c861f) 00000020:00000080:1.0:1788390288.865916:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788390288.867893:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018871e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3285:1875263103172736:0@lo:250: 00000100:00100000:0.0:1788390288.867990:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390288.868066:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103172736 00000100:00100000:0.0:1788390288.868074:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103172736 00000100:00100000:0.0:1788390288.868119:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390288.868127:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056f6be7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1875263103172736:12345-0@lo:250: 00010000:00080000:0.0:1788390288.868151:0:5799:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9@0@lo t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:0.0:1788390288.868705:0:5799:0:(genops.c:1385:class_connect()) connect: client 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9, cookie 0x9aafc5f04cd319ce 00000100:00080000:0.0:1788390288.869017:0:5799:0:(import.c:65:import_set_state_nolock()) 00000000eeca2d18 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390288.869350:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056f6be7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:3285:x1875263103172736:12345-0@lo:250: Request processed in 958us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390288.869360:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390288.869416:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788390288.869426:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1788390288.869436:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788390288.869441:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788390288.869444:0:3285:0:(import.c:65:import_set_state_nolock()) 000000006fc99cc8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788390288.869447:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788390288.869533:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788390288.869539:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018871e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3285:1875263103172736:0@lo:250: 00000100:00100000:1.0:1788390288.872936:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390288.873220:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390288.873226:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788390288.873998:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390288.874025:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788390288.874335:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390288.874400:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788390288.875105:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.875261:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788390288.875273:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788390288.876873:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788390288.876881:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788390288.901995:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.902231:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788390288.902239:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788390288.903618:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788390288.903627:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788390288.904307:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.904439:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390288.904444:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788390288.904896:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390288.904902:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788390288.905629:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.905781:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390288.905786:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788390288.906336:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390288.906343:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788390288.908355:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.908571:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390288.908577:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788390288.909355:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390288.909362:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788390288.925891:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390288.926286:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390288.926300:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788390288.927404:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390288.927411:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788390288.930558:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390288.930574:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788390288.931536:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788390288.931559:0:5788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788390288.931565:0:5788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788390288.931685:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788390288.931737:0:5788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788390288.931741:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788390288.931743:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390288.931745:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390288.931746:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390288.931747:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390288.931748:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390288.931749:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390288.931750:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390288.931751:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390288.931753:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390288.931754:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390288.931755:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390288.931758:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788390288.931760:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390288.931761:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390288.931762:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390288.931763:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390288.931764:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390288.931765:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390288.931766:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390288.931767:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390288.931768:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390288.931769:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390288.931770:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390288.931771:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390288.931800:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788390288.931817:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000394fbade pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103172864:0@lo:253: 00000100:00100000:1.0:1788390288.931907:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390288.931992:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6005a01 going to sleep for 11 seconds 00000100:00100000:3.0:1788390288.932155:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103172864 00000100:00100000:3.0:1788390288.932163:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103172864 00000100:00100000:3.0:1788390288.932214:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390288.932223:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e8c9af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:5788:x1875263103172864:12345-0@lo:253: 20000000:01000000:3.0:1788390288.932265:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788390288.932268:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788390288.932514:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788390288.932563:0:5801:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788390288.932819:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390288.933707:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788390288.934035:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788390288.934039:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788390288.934043:0:5801:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788390288.934046:0:5801:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788390288.934117:0:5801:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788390288.934236:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390288.934438:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788390288.934449:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788390288.934487:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788390288.934526:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788390288.934554:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788390288.934631:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788390288.934639:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788390288.934673:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788390288.934679:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788390288.934704:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788390288.934724:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788390288.934765:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788390288.934805:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788390288.934829:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788390288.934832:0:5801:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788390288.934841:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390288.935288:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788390288.935298:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788390288.935327:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788390288.935354:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788390288.935404:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788390288.935414:0:5801:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788390288.935474:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788390288.935481:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788390288.935533:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788390288.935567:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788390288.935598:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788390288.935608:0:5801:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788390288.935675:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788390288.935683:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788390288.935707:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788390288.935752:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788390288.935880:0:5801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788390288.935920:0:5801:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788390288.935926:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788390288.936336:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788390288.936540:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788390288.936559:0:5801:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:1.0:1788390288.936561:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1788390288.936590:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788390288.936597:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788390288.936619:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788390288.936625:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1788390288.936672:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788390288.936681:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788390288.936706:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788390288.936750:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788390288.936798:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788390288.936801:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788390288.936806:0:5801:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788390288.936812:0:5801:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788390288.937336:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788390288.937432:0:5801:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788390288.942529:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788390288.942575:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788390288.942739:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788390288.942761:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788390288.942764:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788390288.942767:0:5801:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788390288.942779:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788390288.942782:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788390288.942811:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788390288.942813:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788390288.943399:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788390288.943638:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788390288.943677:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788390288.943757:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788390288.943771:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788390288.943773:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788390288.944306:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788390288.944502:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788390288.944538:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788390288.944572:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788390288.944584:0:5801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390288.944587:0:5801:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788390288.944592:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788390288.944611:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944627:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944637:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944643:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944650:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944657:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944662:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000084fe08d already unused, calling callback (000000002020d4e9) 00010000:00010000:3.0:1788390288.944666:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944673:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944684:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944701:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390288.944707:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000084fe08d/0x9aafc5f04cd319d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788390288.944736:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788390289.068809:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e8c9af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:5788:x1875263103172864:12345-0@lo:253: Request processed in 136580us (136894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390289.068830:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390289.068917:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000394fbade pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103172864:0@lo:253: 10000000:01000000:1.0:1788390289.068932:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788390289.068936:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390289.068938:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390289.068939:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390289.068941:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788390289.068942:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390289.068943:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390289.068944:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390289.068945:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390289.068947:0:5788:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788390289.068948:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390289.068950:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788390289.068991:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e06e2398 from lustre-MDT0000 10000000:01000000:1.0:1788390289.069016:0:5788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788390289.069018:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788390289.069022:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d68a8e99b8 10000000:01000000:1.0:1788390289.069025:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390289.069032:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d68a8e99b8 from 1 10000000:01000000:1.0:1788390289.069035:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788390289.069176:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.069194:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.069202:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390289.069220:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000394fbade pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103172992:0@lo:101: 00000100:00100000:1.0:1788390289.069252:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390289.069348:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046d81243 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.069436:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103172992 00000100:00100000:0.0:1788390289.069445:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103172992 00000100:00100000:0.0:1788390289.069498:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390289.069505:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048123e6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:5788:x1875263103172992:12345-0@lo:101: 00010000:00010000:0.0:1788390289.069514:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.069524:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e61dfe5/0x9aafc5f04cd319e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd319dc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.069539:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e61dfe5/0x9aafc5f04cd319e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.069545:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e61dfe5/0x9aafc5f04cd319e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.069551:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e61dfe5, rc 0) 00000100:00100000:0.0:1788390289.069621:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048123e6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5788:x1875263103172992:12345-0@lo:101: Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.069625:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390289.069717:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000394fbade pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103172992:0@lo:101: 00010000:00010000:2.0:1788390289.069729:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.069736:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.069793:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173120:0@lo:501: 00000100:00100000:2.0:1788390289.069819:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.069866:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000499aec86 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.069892:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173120 00000100:00100000:0.0:1788390289.069895:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173120 00000100:00100000:0.0:1788390289.069915:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390289.069918:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b296bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5788:x1875263103173120:12345-0@lo:501: 00000100:00100000:0.0:1788390289.070202:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b296bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5788:x1875263103173120:12345-0@lo:501: Request processed in 283us (382us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390289.070208:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390289.070304:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173120:0@lo:501: 10000000:01000000:2.0:1788390289.070320:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788390289.070358:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070364:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 0000000019f77ba1/0x9aafc5f04cd319dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390289.070369:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6a0d90000 10000000:01000000:2.0:1788390289.070376:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788390289.070379:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d6a0d90000 10000000:01000000:2.0:1788390289.070380:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788390289.070382:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d6a0d90000 from 1 10000000:01000000:2.0:1788390289.070383:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788390289.070395:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070400:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070404:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.070411:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173248:0@lo:101: 00000100:00100000:2.0:1788390289.070428:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.070451:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000499aec86 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.070487:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173248 00000100:00100000:0.0:1788390289.070490:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173248 00000100:00100000:0.0:1788390289.070510:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390289.070513:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a18a5baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5788:x1875263103173248:12345-0@lo:101: 00010000:00010000:0.0:1788390289.070518:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.070528:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000446b3c81/0x9aafc5f04cd319f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd319ea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.070538:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000446b3c81/0x9aafc5f04cd319f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd319ea expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.070542:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000446b3c81/0x9aafc5f04cd319f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd319ea expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.070547:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000446b3c81, rc 0) 00000100:00100000:0.0:1788390289.070573:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a18a5baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:5788:x1875263103173248:12345-0@lo:101: Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.070576:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390289.070699:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173248:0@lo:101: 00010000:00010000:2.0:1788390289.070717:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070725:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390289.070735:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788390289.070810:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070815:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000d05e8502/0x9aafc5f04cd319ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390289.070826:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788390289.070828:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390289.070831:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d6a0d90000 10000000:01000000:2.0:1788390289.070832:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788390289.070834:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788390289.070835:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788390289.070844:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070848:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.070852:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.070858:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173376:0@lo:101: 00000100:00100000:2.0:1788390289.070875:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.070893:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000499aec86 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.070928:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173376 00000100:00100000:0.0:1788390289.070931:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173376 00000100:00100000:0.0:1788390289.070952:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390289.070955:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0f310d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:5788:x1875263103173376:12345-0@lo:101: 00010000:00010000:0.0:1788390289.070982:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.070987:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fbf1111c/0x9aafc5f04cd319ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd319f8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.070996:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbf1111c/0x9aafc5f04cd319ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.071001:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fbf1111c/0x9aafc5f04cd319ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.071005:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fbf1111c, rc 0) 00000100:00100000:0.0:1788390289.071022:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0f310d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+8:5788:x1875263103173376:12345-0@lo:101: Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.071031:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390289.071124:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173376:0@lo:101: 00010000:00010000:2.0:1788390289.071131:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.071136:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.071159:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173504:0@lo:501: 00000100:00100000:2.0:1788390289.071175:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.071192:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000499aec86 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.071239:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173504 00000100:00100000:1.0:1788390289.071242:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173504 00000100:00100000:1.0:1788390289.071263:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390289.071267:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c74d47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+8:5788:x1875263103173504:12345-0@lo:501: 00000100:00100000:1.0:1788390289.071426:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c74d47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5788:x1875263103173504:12345-0@lo:501: Request processed in 159us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.071431:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390289.071518:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173504:0@lo:501: 00000100:00100000:2.0:1788390289.071535:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173632:0@lo:503: 00000100:00100000:2.0:1788390289.071560:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.071624:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000499aec86 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.071703:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173632 00000100:00100000:1.0:1788390289.071717:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173632 00000100:00100000:1.0:1788390289.071779:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390289.071785:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005163782f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5788:x1875263103173632:12345-0@lo:503: 00000100:00100000:1.0:1788390289.071933:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005163782f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5788:x1875263103173632:12345-0@lo:503: Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.071938:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390289.072115:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103173632:0@lo:503: 00000100:00100000:2.0:1788390289.072367:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5830:1875263103173760:0@lo:502: 00000100:00100000:2.0:1788390289.072393:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.072465:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000276cc0a0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.072513:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173760 00000100:00100000:0.0:1788390289.072516:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173760 00000100:00100000:0.0:1788390289.072530:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390289.072533:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015e1d633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5830:x1875263103173760:12345-0@lo:502: 00000100:00100000:0.0:1788390289.072644:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015e1d633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5830:x1875263103173760:12345-0@lo:502: Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.072648:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390289.072765:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5830:1875263103173760:0@lo:502: 00000020:01000000:2.0:1788390289.072786:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390289.072796:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390289.072799:0:5830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788390289.072803:0:5830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788390289.072806:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390289.072817:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000035084ad9) 00000020:00000080:2.0:1788390289.072830:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788390289.072834:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788390289.072882:0:5830:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788390289.072887:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd31a0d 00000020:00000080:2.0:1788390289.073065:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788390289.073068:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390289.073070:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390289.073071:0:5830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788390289.073073:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390289.073075:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390289.073076:0:5830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788390289.073078:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390289.073082:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007f3a1969) 00000020:00000080:2.0:1788390289.073092:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788390289.073095:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788390289.073096:0:5830:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788390289.073098:0:5830:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788390289.073102:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788390289.073139:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e06e2398 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788390289.073148:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000010d55dde) 00000020:00000080:2.0:1788390289.073156:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788390289.073191:0:5830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788390289.073194:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd31a22 00000020:00000080:2.0:1788390289.073251:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788390289.073255:0:5830:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788390289.073257:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aafc5f04cd31a29 00080000:01000000:2.0:1788390289.073260:0:5830:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788390289.073262:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd31a30 00080000:10000000:2.0:1788390289.073524:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788390289.073859:0:5830:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788390289.077219:0:5830:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788390289.121220:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788390289.121548:0:5830:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788390289.129764:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788390289.130278:0:5830:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788390289.151186:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b0fcbebb) 00000020:00000080:3.0:1788390289.151203:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788390289.151259:0:5830:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788390289.151264:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd31a3e 00000020:00000080:3.0:1788390289.152065:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788390289.153112:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.179359:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.205436:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.224105:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.238985:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.250224:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788390289.260276:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aafc5f04cd31a45 00000020:00000080:0.0:1788390289.260529:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788390289.260541:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390289.260547:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390289.260550:0:5830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788390289.260553:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390289.260559:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390289.260560:0:5830:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788390289.260564:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788390289.260600:0:5830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788390289.260726:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390289.260732:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390289.260733:0:5830:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788390289.260736:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390289.260739:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390289.260740:0:5830:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390289.260743:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390289.260744:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788390289.260796:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da48f0e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5830:1875263103173888:0@lo:502: 00000100:00100000:0.0:1788390289.260871:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390289.260914:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103173888 00000100:00100000:1.0:1788390289.260921:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103173888 00000100:00100000:0.0:1788390289.260928:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000001b8e08 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.260956:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390289.260983:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007127eddd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5830:x1875263103173888:12345-0@lo:502: 00000100:00100000:1.0:1788390289.261232:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007127eddd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5830:x1875263103173888:12345-0@lo:502: Request processed in 251us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.261238:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390289.261279:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da48f0e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5830:1875263103173888:0@lo:502: 00000020:01000000:0.0:1788390289.261307:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390289.261311:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390289.261313:0:5830:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390289.261315:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788390289.261382:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788390289.261404:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788390289.261426:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.261438:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000ec32dcdf/0x9aafc5f04cd319f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390289.261457:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d6a0d90000 from 1 10000000:01000000:3.0:1788390289.261461:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390289.261492:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.261499:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.261507:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390289.261517:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174016:0@lo:101: 00000100:00100000:3.0:1788390289.261540:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390289.261564:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea2a0e11 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.261578:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174016 00000100:00100000:0.0:1788390289.261583:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174016 00000100:00100000:0.0:1788390289.261760:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390289.261769:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000334d4162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:5788:x1875263103174016:12345-0@lo:101: 00010000:00010000:0.0:1788390289.261779:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.261790:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31a4c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.261809:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.261818:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.261826:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000fd6322d, rc 0) 00000100:00100000:0.0:1788390289.261861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000334d4162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:5788:x1875263103174016:12345-0@lo:101: Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390289.261884:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174016:0@lo:101: 00010000:00010000:3.0:1788390289.261897:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.261906:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390289.261921:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390289.262446:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174144:0@lo:256: 00000100:00100000:3.0:1788390289.262477:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390289.262500:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea2a0e11 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.262517:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174144 00000100:00100000:1.0:1788390289.262521:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174144 00000100:00100000:1.0:1788390289.262548:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390289.262554:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a2de4a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:5788:x1875263103174144:12345-0@lo:256: 20000000:01000000:1.0:1788390289.262567:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788390289.262574:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788390289.262648:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a2de4a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:5788:x1875263103174144:12345-0@lo:256: Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.262655:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390289.262661:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174144:0@lo:256: 10000000:01000000:3.0:1788390289.263130:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390289.263138:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.263152:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390289.263156:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a0d90000 from 1 10000000:01000000:3.0:1788390289.263159:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390289.263171:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.263177:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.263183:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390289.263194:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174272:0@lo:101: 00000100:00100000:3.0:1788390289.263216:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390289.263236:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea2a0e11 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.263251:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174272 00000100:00100000:0.0:1788390289.263257:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174272 00000100:00100000:0.0:1788390289.263286:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390289.263292:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d86b797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:5788:x1875263103174272:12345-0@lo:101: 00010000:00010000:0.0:1788390289.263298:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.263305:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31a5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.263329:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.263337:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.263343:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ebe1af9, rc 0) 00000100:00100000:0.0:1788390289.263373:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d86b797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174272:12345-0@lo:101: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.263379:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390289.263395:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174272:0@lo:101: 00010000:00010000:3.0:1788390289.263403:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.263407:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390289.263433:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174400:0@lo:501: 00000100:00100000:3.0:1788390289.263452:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390289.263465:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea2a0e11 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.263489:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174400 00000100:00100000:1.0:1788390289.263493:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174400 00000100:00100000:1.0:1788390289.263515:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390289.263531:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ff17183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174400:12345-0@lo:501: 00000100:00100000:1.0:1788390289.264043:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ff17183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174400:12345-0@lo:501: Request processed in 522us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.264050:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390289.264057:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174400:0@lo:501: 00000100:00100000:3.0:1788390289.264085:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174528:0@lo:503: 00000100:00100000:3.0:1788390289.264117:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390289.264193:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea2a0e11 going to sleep for 11 seconds 00000100:00100000:2.0:1788390289.264236:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174528 00000100:00100000:2.0:1788390289.264241:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174528 00000100:00100000:2.0:1788390289.264270:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390289.264276:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bfba24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174528:12345-0@lo:503: 00000040:00080000:2.0:1788390289.264308:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390289.264355:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bfba24e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174528:12345-0@lo:503: Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390289.264359:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390289.264386:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174528:0@lo:503: 00000040:00080000:3.0:1788390289.265078:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788390289.265157:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788390289.265179:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390289.265201:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.265216:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390289.265255:0:5788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788390289.265258:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6a0d90000 10000000:01000000:2.0:1788390289.265261:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6a0d90000 10000000:01000000:2.0:1788390289.265265:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390289.265270:0:5788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a0d90000 from 1 10000000:01000000:2.0:1788390289.265272:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390289.265290:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.265296:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.265303:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.265316:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174656:0@lo:101: 00000100:00100000:2.0:1788390289.265347:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.265434:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 000000004101ba31 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.265577:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174656 00000100:00100000:0.0:1788390289.265581:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174656 00000100:00100000:0.0:1788390289.265623:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390289.265630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c43d441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103174656:12345-0@lo:101: 00010000:00010000:0.0:1788390289.265638:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390289.265646:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4a9a094/0x9aafc5f04cd31a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31a68 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.265662:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4a9a094/0x9aafc5f04cd31a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.265668:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4a9a094/0x9aafc5f04cd31a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.265672:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4a9a094, rc 0) 00000100:00100000:0.0:1788390289.265724:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c43d441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103174656:12345-0@lo:101: Request processed in 95us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.265730:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390289.265750:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174656:0@lo:101: 00010000:00010000:2.0:1788390289.265760:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.265767:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390289.265815:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174784:0@lo:501: 00000100:00100000:2.0:1788390289.265838:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.265860:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 000000004101ba31 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.265875:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174784 00000100:00100000:1.0:1788390289.265880:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174784 00000100:00100000:1.0:1788390289.265903:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390289.265907:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d2f3415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103174784:12345-0@lo:501: 00000100:00100000:1.0:1788390289.266099:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d2f3415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103174784:12345-0@lo:501: Request processed in 191us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.266105:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390289.266158:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174784:0@lo:501: 00000100:00100000:2.0:1788390289.266174:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174912:0@lo:503: 00000100:00100000:2.0:1788390289.266198:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.266217:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 000000004101ba31 going to sleep for 11 seconds 00000100:00100000:3.0:1788390289.266227:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103174912 00000100:00100000:3.0:1788390289.266231:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103174912 00000100:00100000:3.0:1788390289.266259:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390289.266265:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020a315b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103174912:12345-0@lo:503: 00000100:00100000:3.0:1788390289.266541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020a315b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103174912:12345-0@lo:503: Request processed in 276us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390289.266547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390289.266566:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103174912:0@lo:503: 00000100:00100000:2.0:1788390289.266940:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5835:1875263103175040:0@lo:502: 00000100:00100000:2.0:1788390289.267075:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.267112:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08294f5 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.267153:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175040 00000100:00100000:1.0:1788390289.267160:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175040 00000100:00100000:1.0:1788390289.267201:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390289.267205:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10018b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5835:x1875263103175040:12345-0@lo:502: 00000100:00100000:1.0:1788390289.267347:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10018b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5835:x1875263103175040:12345-0@lo:502: Request processed in 142us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.267352:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390289.267403:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5835:1875263103175040:0@lo:502: 00000020:01000004:2.0:1788390289.267439:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788390289.267457:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001fb0e94e) 00000020:00000080:2.0:1788390289.267470:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788390289.267525:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e06e2398 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788390289.267528:0:5835:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e06e2398 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788390289.267531:0:5835:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e06e2398 4 00010000:00080000:2.0:1788390289.267558:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005d4bf8e3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390289.269355:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788390289.269526:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788390289.269701:0:5835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390289.269718:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aafc5f04cd31a7d 00000100:00080000:3.0:1788390289.269726:0:5835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390289.269730:0:5835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005d4bf8e3 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390289.269756:0:5835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a4488db x1875263103175168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390289.269777:0:5835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390289.269808:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103175168:0@lo:38: 00000100:00100000:0.0:1788390289.269868:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390289.269906:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175168 00000100:00100000:1.0:1788390289.269912:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175168 00000100:00100000:1.0:1788390289.269943:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390289.269949:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da48f0e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103175168:12345-0@lo:38: 00000100:00100000:1.0:1788390289.270021:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da48f0e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103175168:12345-0@lo:38: Request processed in 71us (153us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788390289.270028:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390289.270036:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390289.270043:0:3285:0:(import.c:65:import_set_state_nolock()) 000000005d4bf8e3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390289.270047:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788390289.270051:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a4488db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103175168:0@lo:38: 00000100:00100000:2.0:1788390289.270137:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5835:1875263103175296:0@lo:502: 00000100:00100000:2.0:1788390289.270174:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390289.270204:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a08294f5 going to sleep for 11 seconds 00000100:00100000:0.0:1788390289.270246:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175296 00000100:00100000:0.0:1788390289.270251:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175296 00000100:00100000:0.0:1788390289.270282:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390289.270289:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008463762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5835:x1875263103175296:12345-0@lo:502: 00000100:00100000:0.0:1788390289.270506:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008463762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5835:x1875263103175296:12345-0@lo:502: Request processed in 217us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390289.270512:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390289.270568:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5835:1875263103175296:0@lo:502: 00000040:00080000:2.0:1788390289.270588:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788390289.270665:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788390289.270686:0:5788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390289.270702:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.270732:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 0000000051776990/0x9aafc5f04cd31a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390289.270775:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390289.270776:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390289.270778:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390289.270779:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390289.270780:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390289.270781:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390289.270782:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390289.270783:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390289.270784:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390289.270789:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390289.270790:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390289.270792:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390289.270795:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788390289.270798:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390289.270799:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390289.270800:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390289.270801:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390289.270801:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390289.270802:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390289.270802:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390289.270803:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390289.270804:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390289.270805:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390289.270805:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390289.270806:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390289.270821:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788390289.270827:0:5788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8f076b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103175424:0@lo:253: 00000100:00100000:0.0:1788390289.270858:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390289.270879:0:5788:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099b1b501 going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.270894:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175424 00000100:00100000:1.0:1788390289.270899:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175424 00000100:00100000:1.0:1788390289.270922:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390289.270928:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a659744d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5788:x1875263103175424:12345-0@lo:253: 20000000:01000000:1.0:1788390289.270944:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788390289.270954:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788390289.281368:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390289.281383:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788390289.281391:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788390289.281396:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788390289.281413:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.281440:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.281445:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.281472:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390289.281481:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 12 pid: 5801 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390289.281491:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2625c30 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103175552:0@lo:104: 00000100:00100000:3.0:1788390289.281540:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390289.281580:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175552 00000100:00100000:3.0:1788390289.281583:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c0f5c5c going to sleep for 11 seconds 00000100:00100000:1.0:1788390289.281587:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175552 00000100:00100000:1.0:1788390289.281638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390289.281644:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788390289.281646:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220270ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103175552:12345-0@lo:104: 00000100:00100000:3.0:1788390289.281649:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788390289.281656:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.281729:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390289.281740:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220270ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103175552:12345-0@lo:104: Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.281748:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390289.281785:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2625c30 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103175552:0@lo:104: 00010000:00010000:1.0:1788390289.281804:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281820:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390289.281828:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281838:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cec6ccc already unused, calling callback (00000000d671aecd) 10000000:00010000:0.0:1788390289.281841:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281850:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390289.281857:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390289.281864:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390289.281901:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281908:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390289.281928:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281934:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000006cec6ccc/0x9aafc5f04cd31a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a53 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390289.281949:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390289.281951:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390289.281952:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390289.281996:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065eb4557 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103175680:0@lo:103: 00000100:00100000:3.0:1788390289.282029:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390289.282056:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175680 00000100:00100000:1.0:1788390289.282061:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175680 00010000:00010000:1.0:1788390289.282078:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 13 pid: 5801 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390289.282102:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390289.282110:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0828f34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3287:x1875263103175680:12345-0@lo:103: 00010000:00010000:1.0:1788390289.282120:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390289.282124:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 13 pid: 5801 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282134:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 13 pid: 5801 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282147:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000fd6322d/0x9aafc5f04cd31a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31a4c expref: 13 pid: 5801 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282160:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282167:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390289.282178:0:5792:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000783337s 00010000:00010000:1.0:1788390289.282187:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282193:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282197:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282201:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282204:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005cd543ef already unused, calling callback (000000002020d4e9) 00010000:00010000:1.0:1788390289.282207:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282213:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282229:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390289.282237:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390289.282244:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.282255:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390289.282262:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005cd543ef/0x9aafc5f04cd31a84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390289.282267:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0828f34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3287:x1875263103175680:12345-0@lo:103: Request processed in 158us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390289.282277:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065eb4557 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103175680:0@lo:103: 00000100:00100000:1.0:1788390289.282278:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390289.285820:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a659744d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5788:x1875263103175424:12345-0@lo:253: Request processed in 14881us (14950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390289.285834:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390289.285841:0:5788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8f076b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5788:1875263103175424:0@lo:253: 10000000:01000000:0.0:1788390289.285856:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788390289.285859:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390289.285862:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390289.285863:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390289.285865:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390289.285866:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390289.285867:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390289.285868:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390289.285870:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390289.285871:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390289.285873:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390289.285874:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390289.285875:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788390289.285885:0:5788:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788390289.289080:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390289.289450:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390289.289631:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390289.289818:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390289.290014:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390289.290170:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390289.290581:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.290737:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390289.290899:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.291092:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390289.291248:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390289.291360:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788390289.305179:0:5788:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788390289.319069:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788390289.319151:0:5841:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788390289.319156:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788390289.319582:0:5842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788390289.323325:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788390289.323532:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788390289.323915:0:5788:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788390289.323922:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788390289.324088:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390289.325085:0:5788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788390289.325518:0:5788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788390289.325553:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788390289.325819:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788390289.326117:0:5788:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788390289.328062:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788390289.328308:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788390289.328523:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788390289.328873:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788390289.329850:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788390289.330065:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788390289.330235:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788390289.330415:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788390289.330578:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788390289.331449:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788390289.332862:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788390289.333414:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788390289.333626:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788390289.333829:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788390289.334064:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788390289.334278:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788390289.334647:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788390289.335216:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788390289.335412:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788390289.335638:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788390289.335915:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788390289.336133:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788390289.336286:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788390289.336461:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788390289.336626:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788390289.336815:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788390289.336995:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788390289.337188:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788390289.337383:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788390289.337561:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788390289.337760:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788390289.337925:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788390289.338319:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788390289.347207:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788390289.369845:0:5788:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788390289.369886:0:5788:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8581c77988 00100000:10000000:0.0:1788390289.369903:0:5788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788390289.370309:0:5788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390289.370324:0:5788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390289.370340:0:5788:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788390289.370367:0:5788:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788390289.383034:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788390289.383107:0:5842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788390289.383112:0:5842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788390289.869713:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390290.893081:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390291.209525:0:6084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788390291.918787:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390292.941317:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390293.965381:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390294.477083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788390294.477091:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788390294.477094:0:8:0:(import.c:65:import_set_state_nolock()) 000000005d4bf8e3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390294.477131:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005d4bf8e3 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390294.477153:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004f036b19 x1875263103175936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390294.477235:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f036b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103175936:0@lo:38: 00000100:00100000:1.0:1788390294.477321:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390294.477861:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175936 00000100:00100000:0.0:1788390294.477868:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175936 00000100:00100000:0.0:1788390294.477899:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390294.477907:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898cab4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103175936:12345-0@lo:38: 00010000:00080000:0.0:1788390294.477930:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:0.0:1788390294.478131:0:5807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aafc5f04cd31a8b 00000004:00100000:0.0:1788390294.478175:0:5807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788390294.478231:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8f076b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103175808:0@lo:400: 00000100:00100000:2.0:1788390294.478266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390294.478347:0:5807:0:(import.c:65:import_set_state_nolock()) 000000004e38a603 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390294.478391:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103175808 00000100:00100000:1.0:1788390294.478396:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103175808 00000100:00100000:1.0:1788390294.478430:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390294.478436:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc9aff27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3288:x1875263103175808:12345-0@lo:400: 00000100:00100000:0.0:1788390294.478456:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898cab4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103175936:12345-0@lo:38: Request processed in 548us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390294.478463:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390294.478469:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc9aff27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3288:x1875263103175808:12345-0@lo:400: Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390294.478474:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788390294.478524:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004f036b19 x1875263103175936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390294.478538:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788390294.478545:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788390294.478549:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788390294.478551:0:3285:0:(import.c:65:import_set_state_nolock()) 000000005d4bf8e3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390294.478670:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f036b19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103175936:0@lo:38: 00000100:00100000:2.0:1788390294.478703:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8f076b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103175808:0@lo:400: 00000020:00000080:3.0:1788390294.762288:0:6287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd3a8f9c0 20000000:00000080:3.0:1788390294.762304:0:6287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d6b6545c00 uarg=0000000000000000 20000000:01000000:3.0:1788390294.762327:0:6287:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788390294.762332:0:6287:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788390294.762335:0:6287:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788390294.762519:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788390294.762527:0:6287:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788390294.766731:0:6287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390294.766905:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788390294.766938:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788390294.767066:0:6287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788390294.767079:0:6287:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390294.767092:0:6287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390294.767107:0:6287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390294.767111:0:6287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390294.767140:0:6287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390294.767149:0:6287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 10 pid: 5801 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390294.767159:0:6287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000042f2eb0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6287:1875263103176064:0@lo:104: 00000100:00100000:3.0:1788390294.767207:0:6287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390294.767297:0:6287:0:(client.c:2715:ptlrpc_set_wait()) set 000000006cc16842 going to sleep for 11 seconds 00000100:00100000:2.0:1788390294.769000:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176064 00000100:00100000:2.0:1788390294.769010:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176064 00000100:00100000:2.0:1788390294.769050:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390294.769056:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb24d4b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:6287:x1875263103176064:12345-0@lo:104: 00010000:00010000:2.0:1788390294.769067:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769131:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390294.769135:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb24d4b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:6287:x1875263103176064:12345-0@lo:104: Request processed in 79us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390294.769140:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788390294.769165:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390294.769169:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769173:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000015d652c3 already unused, calling callback (00000000d671aecd) 10000000:00010000:2.0:1788390294.769176:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769180:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390294.769184:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390294.769187:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390294.769209:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769213:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390294.769224:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769228:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 0000000015d652c3/0x9aafc5f04cd31a5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a61 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769245:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390294.769246:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390294.769247:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390294.769252:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390294.769261:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103176192:0@lo:103: 00000100:00100000:2.0:1788390294.769285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390294.769314:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176192 00000100:00100000:2.0:1788390294.769316:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176192 00010000:00010000:2.0:1788390294.769327:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 11 pid: 5801 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390294.769340:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390294.769343:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075c13ce5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3288:x1875263103176192:12345-0@lo:103: 00010000:00010000:2.0:1788390294.769351:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390294.769354:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 11 pid: 5801 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769360:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 11 pid: 5801 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769371:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769375:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769383:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769394:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769398:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769401:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769403:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b8fcc4fd already unused, calling callback (000000002020d4e9) 00010000:00010000:2.0:1788390294.769405:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769409:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769413:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390294.769419:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390294.769437:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075c13ce5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3288:x1875263103176192:12345-0@lo:103: Request processed in 93us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390294.769441:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390294.769466:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a934324 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103176192:0@lo:103: 00010000:00010000:1.0:1788390294.769574:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ebe1af9/0x9aafc5f04cd31a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31a5a expref: 10 pid: 5801 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390294.769586:0:6287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000042f2eb0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6287:1875263103176064:0@lo:104: 00010000:00010000:1.0:1788390294.769599:0:6287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390294.769606:0:6287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390294.769610:0:6287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390294.769615:0:6287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b8fcc4fd/0x9aafc5f04cd31a92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390294.989143:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390296.013119:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390297.041302:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390298.061199:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788390298.509087:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390298.509095:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d6a0d90000 from 3 10000000:01000000:1.0:1788390298.509100:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390298.509146:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390298.509172:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390298.509183:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390298.509205:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccdf55da pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176320:0@lo:101: 00000100:00100000:1.0:1788390298.509272:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390298.509325:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3cd671 going to sleep for 11 seconds 00000100:00100000:0.0:1788390298.509392:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176320 00000100:00100000:0.0:1788390298.509400:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176320 00000100:00100000:0.0:1788390298.509457:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390298.509466:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5fe73c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:5803:x1875263103176320:12345-0@lo:101: 00010000:00010000:0.0:1788390298.509479:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390298.509491:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2ea9548/0x9aafc5f04cd31aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31a99 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390298.509511:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2ea9548/0x9aafc5f04cd31aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390298.509521:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2ea9548/0x9aafc5f04cd31aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390298.509529:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2ea9548, rc 0) 00000100:00100000:0.0:1788390298.509579:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5fe73c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5803:x1875263103176320:12345-0@lo:101: Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390298.509586:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390298.509676:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccdf55da pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176320:0@lo:101: 00010000:00010000:3.0:1788390298.509689:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.509697:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390298.509742:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176448:0@lo:256: 00000100:00100000:3.0:1788390298.509771:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.509792:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000962ea1c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788390298.509836:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176448 00000100:00100000:0.0:1788390298.509840:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176448 00000100:00100000:0.0:1788390298.509867:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390298.509873:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043f54076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5803:x1875263103176448:12345-0@lo:256: 20000000:01000000:0.0:1788390298.509885:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390298.509900:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390298.509907:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788390298.510007:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043f54076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5803:x1875263103176448:12345-0@lo:256: Request processed in 134us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390298.510014:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390298.510215:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176448:0@lo:256: 10000000:01000000:3.0:1788390298.510253:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390298.510259:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510266:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000000ed2de2d/0x9aafc5f04cd31a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390298.510274:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788390298.510275:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a0d90000 from 1 10000000:01000000:3.0:1788390298.510277:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390298.510293:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f7ade054/0x9aafc5f04cd31aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510299:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000f7ade054/0x9aafc5f04cd31aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510305:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000f7ade054/0x9aafc5f04cd31aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390298.510316:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176576:0@lo:101: 00000100:00100000:3.0:1788390298.510340:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.510365:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000962ea1c6 going to sleep for 11 seconds 00000100:00100000:3.0:1788390298.510377:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176576 00000100:00100000:3.0:1788390298.510380:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176576 00000100:00100000:3.0:1788390298.510399:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390298.510404:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a6734a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:5803:x1875263103176576:12345-0@lo:101: 00010000:00010000:3.0:1788390298.510410:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390298.510417:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aeecb4d2/0x9aafc5f04cd31aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31aa7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510439:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aeecb4d2/0x9aafc5f04cd31aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510447:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aeecb4d2/0x9aafc5f04cd31aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510454:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aeecb4d2, rc 0) 00000100:00100000:3.0:1788390298.510480:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a6734a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103176576:12345-0@lo:101: Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390298.510485:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390298.510512:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176576:0@lo:101: 00010000:00010000:3.0:1788390298.510522:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000f7ade054/0x9aafc5f04cd31aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.510527:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000f7ade054/0x9aafc5f04cd31aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390298.510564:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176704:0@lo:501: 00000100:00100000:3.0:1788390298.510585:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.510596:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000962ea1c6 going to sleep for 11 seconds 00000100:00100000:3.0:1788390298.510606:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176704 00000100:00100000:3.0:1788390298.510609:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176704 00000100:00100000:3.0:1788390298.510635:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390298.510641:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f6822f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103176704:12345-0@lo:501: 00000100:00100000:3.0:1788390298.510867:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f6822f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103176704:12345-0@lo:501: Request processed in 226us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390298.510873:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390298.510904:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176704:0@lo:501: 00000100:00100000:3.0:1788390298.510926:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176832:0@lo:503: 00000100:00100000:3.0:1788390298.510979:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.510992:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000962ea1c6 going to sleep for 11 seconds 00000100:00100000:3.0:1788390298.511002:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176832 00000100:00100000:3.0:1788390298.511006:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176832 00000100:00100000:3.0:1788390298.511021:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390298.511026:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094a09f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103176832:12345-0@lo:503: 00000100:00100000:3.0:1788390298.511133:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094a09f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103176832:12345-0@lo:503: Request processed in 106us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390298.511139:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390298.511171:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103176832:0@lo:503: 00000100:00100000:3.0:1788390298.511327:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6517:1875263103176960:0@lo:502: 00000100:00100000:3.0:1788390298.511356:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.511372:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103176960 00000100:00100000:3.0:1788390298.511376:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103176960 00000100:00100000:3.0:1788390298.511391:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390298.511396:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6dd02cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6517:x1875263103176960:12345-0@lo:502: 00000100:00100000:3.0:1788390298.511488:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6dd02cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6517:x1875263103176960:12345-0@lo:502: Request processed in 91us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390298.511494:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390298.511518:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011577c70 going to sleep for 11 seconds 00000100:00100000:3.0:1788390298.511528:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f056263 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6517:1875263103176960:0@lo:502: 00000020:01000000:3.0:1788390298.511547:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390298.511555:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390298.511557:0:6517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788390298.511568:0:6517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6a0d90000 00000020:00000080:3.0:1788390298.511570:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788390298.511605:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6517:1875263103177088:0@lo:502: 00000100:00100000:3.0:1788390298.511648:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390298.511664:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177088 00000100:00100000:3.0:1788390298.511667:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177088 00000100:00100000:3.0:1788390298.511683:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390298.511688:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6517:x1875263103177088:12345-0@lo:502: 00000100:00100000:3.0:1788390298.511764:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6517:x1875263103177088:12345-0@lo:502: Request processed in 75us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390298.511770:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390298.511793:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390298.511803:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6517:1875263103177088:0@lo:502: 00000020:01000000:3.0:1788390298.511818:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390298.511821:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390298.511823:0:6517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788390298.511826:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788390298.511866:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788390298.511879:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390298.511884:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390298.511893:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390299.086988:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390299.601103:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103177344:0@lo:400: 00000100:00100000:3.0:1788390299.601173:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390299.601222:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390299.601236:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103177216:0@lo:400: 00000100:00100000:3.0:1788390299.601264:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390299.601300:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177344 00000100:00100000:3.0:1788390299.601307:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177344 00000100:00100000:3.0:1788390299.601350:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390299.601359:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103177344:12345-0@lo:400: 00000100:00100000:3.0:1788390299.601409:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103177344:12345-0@lo:400: Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390299.601416:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390299.601437:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177216 00000100:00100000:3.0:1788390299.601441:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177216 00000100:00100000:3.0:1788390299.601462:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788390299.609000:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d682e96a00 x1875263103177344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390299.609021:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103177344:0@lo:400: 00000100:00100000:2.0:1788390299.611182:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3287:x1875263103177216:12345-0@lo:400: 00000100:00100000:2.0:1788390299.612482:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3287:x1875263103177216:12345-0@lo:400: Request processed in 2492us (11210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390299.612500:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390299.613486:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103177216:0@lo:400: 00010000:00010000:2.0:1788390300.112850:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390301.137903:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390301.404839:0:6648:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788390301.404842:0:6648:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788390301.405024:0:6648:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d69fc01000 00000020:01000004:3.0:1788390301.405038:0:6648:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788390301.405050:0:6648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788390301.405062:0:6648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d68a8eb370) 00000020:00000080:3.0:1788390301.405077:0:6648:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788390301.421104:0:6648:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788390301.421357:0:6648:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788390301.442065:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788390301.447187:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788390301.447221:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788390301.447279:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390301.447305:0:6648:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788390301.447807:0:6648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788390301.447817:0:6648:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390301.447828:0:6648:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd31abc 00000020:01000004:1.0:1788390301.447835:0:6648:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788390301.447853:0:6648:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390301.447856:0:6648:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390301.447861:0:6648:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788390301.447865:0:6648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788390301.447876:0:6648:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d68a660000) 00000020:00000080:1.0:1788390301.447885:0:6648:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788390301.449239:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390301.449392:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390301.449399:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788390301.452924:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390301.452935:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788390301.456161:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788390301.456174:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788390301.457721:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390301.457904:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788390301.457916:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788390301.465117:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788390301.465138:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788390301.485529:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390301.485858:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788390301.485865:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788390301.487119:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390301.487129:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788390301.487896:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788390301.487902:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788390301.490038:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390301.490223:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788390301.490234:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788390301.491139:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390301.491147:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788390301.525116:0:6648:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390301.525334:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788390301.525340:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788390301.526375:0:6648:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788390301.526383:0:6648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788390301.526775:0:6648:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788390301.526798:0:6648:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788390301.526804:0:6648:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788390301.544978:0:6648:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788390301.545013:0:6648:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788390301.545017:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788390301.545019:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788390301.545021:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390301.545022:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390301.545023:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390301.545024:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390301.545026:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390301.545028:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390301.545030:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390301.545032:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390301.545033:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390301.545037:0:6648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788390301.545039:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390301.545040:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788390301.545041:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390301.545046:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390301.545047:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390301.545048:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390301.545049:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390301.545050:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390301.545051:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390301.545052:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390301.545053:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390301.545082:0:6648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788390301.545099:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103177472:0@lo:253: 00000100:00100000:2.0:1788390301.545171:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.545551:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.545664:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177472 00000100:00100000:0.0:1788390301.545672:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177472 00000100:00100000:0.0:1788390301.545750:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390301.545761:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103177472:12345-0@lo:253: 20000000:01000000:0.0:1788390301.545799:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788390301.545803:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788390301.545808:0:5801:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788390301.545811:0:5801:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788390301.546760:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390301.546924:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788390301.546935:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788390301.546990:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788390301.547000:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788390301.547028:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788390301.547070:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788390301.547404:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788390301.547420:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1788390301.547422:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1788390301.547626:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788390301.547635:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390301.547684:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788390301.547692:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1788390301.547722:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788390301.547729:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788390301.547755:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788390301.547798:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788390301.548754:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788390301.548771:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1788390301.548774:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1788390301.548805:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788390301.548812:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788390301.548837:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788390301.548843:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1788390301.548880:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788390301.548887:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788390301.548917:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788390301.549231:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788390301.549248:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788390301.549251:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788390301.549254:0:5801:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788390301.549264:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788390301.549266:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788390301.549294:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788390301.549296:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788390301.549898:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788390301.550157:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788390301.550197:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788390301.550270:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788390301.550282:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788390301.550284:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390301.551130:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390301.551179:0:6664:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390301.551226:0:6664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788390301.551430:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788390301.551542:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788390301.551628:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788390301.551642:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788390301.551644:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788390301.552165:0:6665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788390301.552211:0:6665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788390301.552258:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788390301.552566:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788390301.552618:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788390301.552674:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788390301.552689:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788390301.552691:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788390301.552699:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788390301.552717:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552734:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552741:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552748:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552756:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552791:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.552805:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.552817:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177600:0@lo:104: 00000100:00100000:1.0:1788390301.553208:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390301.553306:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.553315:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 12 pid: 5801 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.553333:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177728:0@lo:104: 00000100:00100000:1.0:1788390301.553362:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390301.553464:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.553472:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 12 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.553481:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177856:0@lo:104: 00000100:00100000:1.0:1788390301.553499:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.553515:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177600 00000100:00100000:2.0:1788390301.553522:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177600 00000100:00100000:3.0:1788390301.553631:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177728 00000100:00100000:3.0:1788390301.553636:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177728 00000100:00100000:3.0:1788390301.553675:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390301.553683:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:5801:x1875263103177600:12345-0@lo:104: 00010000:00010000:3.0:1788390301.553695:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553740:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390301.553745:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:5801:x1875263103177600:12345-0@lo:104: Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.553751:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390301.553768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390301.553774:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103177728:12345-0@lo:104: 00010000:00010000:3.0:1788390301.553780:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553805:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390301.553809:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103177728:12345-0@lo:104: Request processed in 36us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.553814:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788390301.553829:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390301.553835:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553856:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390301.553860:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553868:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390301.553875:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.553880:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390301.553905:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553911:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390301.553927:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553933:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdd800/0x9aafc5f04cd31a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31a6f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553945:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390301.553948:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553954:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390301.553957:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.553994:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390301.554000:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.554005:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390301.554017:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554022:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390301.554027:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554033:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd319f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554042:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.554044:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.554045:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390301.554062:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103177984:0@lo:103: 00000100:00100000:3.0:1788390301.554089:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.554115:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390301.554120:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103178112:0@lo:103: 00000100:00100000:3.0:1788390301.554140:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.554171:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177984 00000100:00100000:3.0:1788390301.554175:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177984 00010000:00010000:3.0:1788390301.554191:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 13 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.554221:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178112 00000100:00100000:3.0:1788390301.554224:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178112 00010000:00010000:3.0:1788390301.554234:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 14 pid: 5801 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.554244:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390301.554249:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103177984:12345-0@lo:103: 00010000:00010000:3.0:1788390301.554257:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390301.554262:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 14 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554271:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 14 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554284:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390301.554309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103177984:12345-0@lo:103: Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.554315:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390301.554327:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390301.554334:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103178112:12345-0@lo:103: 00010000:00010000:3.0:1788390301.554340:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390301.554344:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 13 pid: 5801 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554351:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 13 pid: 5801 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554360:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390301.554383:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103178112:12345-0@lo:103: Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.554389:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390301.554420:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103178112:0@lo:103: 00000100:00100000:3.0:1788390301.554428:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103177984:0@lo:103: 00010000:00010000:0.0:1788390301.554574:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390301.554647:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a226c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390301.554661:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31a68 expref: 12 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.554671:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177600:0@lo:104: 00010000:00010000:1.0:1788390301.554680:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031200/0x9aafc5f04cd319ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd319f8 expref: 11 pid: 5801 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.554688:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177728:0@lo:104: 00000100:00100000:3.0:1788390301.554728:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103177856 00000100:00100000:3.0:1788390301.554732:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103177856 00000100:00100000:3.0:1788390301.554788:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390301.554795:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103177856:12345-0@lo:104: 00010000:00010000:3.0:1788390301.554804:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554846:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390301.554851:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103177856:12345-0@lo:104: Request processed in 58us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.554856:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788390301.554868:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390301.554873:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554878:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813de200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390301.554882:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554888:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390301.554895:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.554906:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390301.554927:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554933:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390301.554946:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554952:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd319dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd319e3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.554989:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.554991:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.554992:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390301.555000:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103178240:0@lo:103: 00000100:00100000:3.0:1788390301.555023:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.555058:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178240 00000100:00100000:3.0:1788390301.555062:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178240 00010000:00010000:3.0:1788390301.555073:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 11 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.555088:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390301.555093:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3286:x1875263103178240:12345-0@lo:103: 00010000:00010000:3.0:1788390301.555100:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390301.555104:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 11 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555112:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 11 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555130:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555138:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555151:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555159:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555166:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555172:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555177:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813dfa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390301.555181:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555188:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555195:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.555204:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390301.555230:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3286:x1875263103178240:12345-0@lo:103: Request processed in 136us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.555244:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390301.555268:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103178240:0@lo:103: 00010000:00010000:1.0:1788390301.555341:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031000/0x9aafc5f04cd319e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd319dc expref: 10 pid: 5800 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.555351:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103177856:0@lo:104: 00010000:00010000:1.0:1788390301.555366:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.555373:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.555385:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.555391:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31aca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390301.555403:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788390301.597800:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:6648:x1875263103177472:12345-0@lo:253: Request processed in 52027us (52615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.597815:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390301.597940:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103177472:0@lo:253: 10000000:01000000:3.0:1788390301.597990:0:6648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788390301.597995:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390301.597997:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390301.597998:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390301.597999:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788390301.598001:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390301.598002:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390301.598004:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390301.598005:0:6648:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788390301.598007:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390301.598008:0:6648:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390301.598027:0:6648:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d69fc01000 from lustre-OST0000 10000000:01000000:3.0:1788390301.598052:0:6648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788390301.598054:0:6648:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788390301.598061:0:6648:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d68a8e99b8 local copy 10000000:01000000:3.0:1788390301.598064:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788390301.598111:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.598123:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.598139:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.598163:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178368:0@lo:101: 00000100:00100000:3.0:1788390301.598207:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.598259:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc2649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.598335:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178368 00000100:00100000:0.0:1788390301.598341:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178368 00000100:00100000:0.0:1788390301.598388:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390301.598397:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:6648:x1875263103178368:12345-0@lo:101: 00010000:00010000:0.0:1788390301.598408:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390301.598421:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031c00/0x9aafc5f04cd31ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31ad1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.598442:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031c00/0x9aafc5f04cd31ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31ad1 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.598459:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031c00/0x9aafc5f04cd31ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31ad1 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.598467:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031c00, rc 0) 00000100:00100000:0.0:1788390301.598513:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:6648:x1875263103178368:12345-0@lo:101: Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.598524:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390301.598680:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178368:0@lo:101: 00010000:00010000:3.0:1788390301.598692:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.598699:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.598801:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178496:0@lo:501: 00000100:00100000:3.0:1788390301.598830:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.598855:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc2649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.598910:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178496 00000100:00100000:0.0:1788390301.598925:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178496 00000100:00100000:0.0:1788390301.598986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390301.598999:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:6648:x1875263103178496:12345-0@lo:501: 00000100:00100000:0.0:1788390301.599230:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:6648:x1875263103178496:12345-0@lo:501: Request processed in 237us (399us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390301.599237:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390301.599342:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178496:0@lo:501: 10000000:01000000:3.0:1788390301.599353:0:6648:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390301.599376:0:6648:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390301.599380:0:6648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.599388:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.599395:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.599631:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390301.599652:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d69fc01000 10000000:01000000:3.0:1788390301.599657:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390301.599661:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d68a8e99b8 10000000:01000000:3.0:1788390301.599664:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788390301.599667:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d68a8e99b8 from 1 10000000:01000000:3.0:1788390301.599677:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788390301.599695:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.599703:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.599711:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.599722:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178624:0@lo:101: 00000100:00100000:3.0:1788390301.599746:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.599776:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390301.599914:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178624 00000100:00100000:1.0:1788390301.599919:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178624 00000100:00100000:1.0:1788390301.599954:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390301.600083:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+10:6648:x1875263103178624:12345-0@lo:101: 00010000:00010000:1.0:1788390301.600091:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390301.600118:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31ae6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31adf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.600136:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31ae6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31adf expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.600145:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31ae6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31adf expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.600169:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813dfa00, rc 0) 00000100:00100000:1.0:1788390301.600208:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:6648:x1875263103178624:12345-0@lo:101: Request processed in 247us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390301.600214:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390301.600283:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178624:0@lo:101: 00010000:00010000:3.0:1788390301.600294:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.600302:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.600328:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788390301.600351:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.600358:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.600365:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788390301.600368:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390301.600372:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788390301.600380:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390301.600393:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.600399:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.600406:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.600416:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178752:0@lo:101: 00000100:00100000:3.0:1788390301.600438:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.600470:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390301.600609:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178752 00000100:00100000:2.0:1788390301.600614:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178752 00000100:00100000:2.0:1788390301.600638:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390301.600644:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:6648:x1875263103178752:12345-0@lo:101: 00010000:00010000:2.0:1788390301.600651:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390301.600659:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31aed expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.600673:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.600681:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.600687:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdde00, rc 0) 00000100:00100000:2.0:1788390301.600712:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103178752:12345-0@lo:101: Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.600718:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390301.600805:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178752:0@lo:101: 00010000:00010000:3.0:1788390301.600831:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.600839:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.600902:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178880:0@lo:501: 00000100:00100000:3.0:1788390301.600925:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.600956:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390301.601044:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103178880 00000100:00100000:2.0:1788390301.601048:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103178880 00000100:00100000:2.0:1788390301.601077:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390301.601083:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103178880:12345-0@lo:501: 00000100:00100000:2.0:1788390301.601293:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103178880:12345-0@lo:501: Request processed in 209us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.601299:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390301.601393:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103178880:0@lo:501: 00000100:00100000:3.0:1788390301.601417:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179008:0@lo:503: 00000100:00100000:3.0:1788390301.601469:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.601583:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390301.601666:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179008 00000100:00100000:2.0:1788390301.601671:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179008 00000100:00100000:2.0:1788390301.601702:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390301.601709:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179008:12345-0@lo:503: 00000100:00100000:2.0:1788390301.601855:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179008:12345-0@lo:503: Request processed in 146us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.601861:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390301.602007:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179008:0@lo:503: 00000040:00080000:3.0:1788390301.602369:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390301.602438:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179136:0@lo:502: 00000100:00100000:3.0:1788390301.602481:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.602616:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390301.602673:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179136 00000100:00100000:2.0:1788390301.602678:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179136 00000100:00100000:2.0:1788390301.602720:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390301.602728:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179136:12345-0@lo:502: 00000100:00100000:2.0:1788390301.602896:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179136:12345-0@lo:502: Request processed in 169us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.602903:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390301.603000:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179136:0@lo:502: 00000040:00080000:1.0:1788390301.603282:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788390301.603327:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788390301.603375:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788390301.603421:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788390301.603456:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788390301.603645:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788390301.603685:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179264:0@lo:502: 00000100:00100000:1.0:1788390301.603722:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390301.603805:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788390301.603897:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390301.603905:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.603915:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390301.603919:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.603928:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390301.603935:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390301.603948:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390301.603988:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.603995:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390301.604031:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.604038:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0200/0x9aafc5f04cd31ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31ad8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.604071:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390301.604073:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390301.604075:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390301.604130:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103179392:0@lo:103: 00000100:00100000:1.0:1788390301.604174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.604271:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179392 00000100:00100000:0.0:1788390301.604276:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179392 00000100:00100000:0.0:1788390301.604333:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390301.604341:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3287:x1875263103179392:12345-0@lo:103: 00010000:00010000:0.0:1788390301.604351:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390301.604364:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031c00/0x9aafc5f04cd31ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31ad1 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.604375:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390301.604404:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:3287:x1875263103179392:12345-0@lo:103: Request processed in 64us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.604411:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390301.604486:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103179392:0@lo:103: 00000100:00100000:3.0:1788390301.604681:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179264 00000100:00100000:3.0:1788390301.604685:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179264 00000100:00100000:3.0:1788390301.604752:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390301.604760:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:6648:x1875263103179264:12345-0@lo:502: 00000100:00100000:3.0:1788390301.604979:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:6648:x1875263103179264:12345-0@lo:502: Request processed in 202us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.604987:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390301.605085:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179264:0@lo:502: 00000040:00080000:1.0:1788390301.605219:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788390301.605230:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788390301.605774:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788390301.605782:0:6666:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788390301.605787:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390301.605789:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788390301.605794:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390301.605813:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d6bc27cd28) 00000020:00000080:0.0:1788390301.605830:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788390301.605836:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788390301.605893:0:6666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d69fc01000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788390301.605900:0:6666:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788390301.605906:0:6666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd31b02 00010000:00010000:0.0:1788390301.609469:0:6666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788390301.609810:0:6666:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788390301.612175:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788390301.612452:0:6666:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788390301.618449:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788390301.619174:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788390301.620496:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788390301.620515:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390301.620521:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390301.620529:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788390301.620533:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390301.620537:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390301.620539:0:6666:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390301.620542:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390301.620543:0:6666:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788390301.620671:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390301.620676:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390301.620677:0:6666:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788390301.620687:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788390301.620847:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788390301.620883:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788390301.620910:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.620921:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390301.620933:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69fc01000 from 1 10000000:01000000:0.0:1788390301.620936:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390301.621000:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.621009:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.621026:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390301.621047:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179520:0@lo:101: 00000100:00100000:0.0:1788390301.621139:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.623176:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.623234:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179520 00000100:00100000:3.0:1788390301.623242:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179520 00000100:00100000:3.0:1788390301.623308:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390301.623316:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:6648:x1875263103179520:12345-0@lo:101: 00010000:00010000:3.0:1788390301.623328:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390301.623342:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b09 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.623363:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.623370:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.623376:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788390301.623458:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179520:12345-0@lo:101: Request processed in 142us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.623471:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788390301.623586:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179520:0@lo:101: 00010000:00010000:0.0:1788390301.623612:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.623621:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390301.623711:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179648:0@lo:501: 00000100:00100000:0.0:1788390301.623743:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.623788:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.623818:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179648 00000100:00100000:3.0:1788390301.623821:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179648 00000100:00100000:3.0:1788390301.623845:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390301.623850:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179648:12345-0@lo:501: 00000100:00100000:3.0:1788390301.625749:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179648:12345-0@lo:501: Request processed in 1894us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.625758:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390301.627155:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179648:0@lo:501: 00000100:00100000:0.0:1788390301.627194:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179776:0@lo:503: 00000100:00100000:0.0:1788390301.627234:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.627270:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.627435:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179776 00000100:00100000:3.0:1788390301.627440:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179776 00000100:00100000:3.0:1788390301.627474:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390301.627480:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179776:12345-0@lo:503: 00000100:00100000:3.0:1788390301.627717:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179776:12345-0@lo:503: Request processed in 236us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.627725:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390301.627862:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179776:0@lo:503: 00000040:00080000:0.0:1788390301.628119:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390301.628175:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179904:0@lo:502: 00000100:00100000:0.0:1788390301.628206:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.628232:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.628615:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103179904 00000100:00100000:3.0:1788390301.628621:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103179904 00000100:00100000:3.0:1788390301.628657:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390301.628665:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179904:12345-0@lo:502: 00000100:00100000:3.0:1788390301.628840:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103179904:12345-0@lo:502: Request processed in 175us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.628847:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390301.628958:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103179904:0@lo:502: 00000040:00080000:0.0:1788390301.629254:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788390301.629314:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788390301.629350:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180032:0@lo:502: 00000100:00100000:0.0:1788390301.629399:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390301.629420:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390301.629488:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180032 00000100:00100000:1.0:1788390301.629493:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180032 00000100:00100000:1.0:1788390301.629544:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390301.629552:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103180032:12345-0@lo:502: 00000100:00100000:1.0:1788390301.629772:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103180032:12345-0@lo:502: Request processed in 221us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390301.629785:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390301.629911:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180032:0@lo:502: 00000040:00080000:0.0:1788390301.630072:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788390301.630087:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788390301.630642:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390301.630652:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390301.630654:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390301.630660:0:6670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d69fc01000 00000020:00000080:0.0:1788390301.630662:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390301.630681:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390301.630691:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390301.630693:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788390301.630695:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788390301.630807:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788390301.630824:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390301.630883:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.630893:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390301.630931:0:6648:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788390301.630934:0:6648:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d69fc01000 10000000:01000000:1.0:1788390301.630937:0:6648:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d69fc01000 10000000:01000000:1.0:1788390301.630941:0:6648:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390301.630946:0:6648:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d69fc01000 from 1 10000000:01000000:1.0:1788390301.630948:0:6648:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390301.631001:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.631009:0:6648:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.631017:0:6648:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390301.631041:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180160:0@lo:101: 00000100:00100000:1.0:1788390301.631076:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390301.631104:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.631218:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180160 00000100:00100000:0.0:1788390301.631224:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180160 00000100:00100000:0.0:1788390301.631259:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390301.631267:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103180160:12345-0@lo:101: 00010000:00010000:0.0:1788390301.631276:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390301.631287:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b17 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.631306:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.631314:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390301.631322:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030200, rc 0) 00000100:00100000:0.0:1788390301.631393:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180160:12345-0@lo:101: Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.631399:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390301.631570:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180160:0@lo:101: 00010000:00010000:2.0:1788390301.631585:0:6648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.631603:0:6648:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390301.631695:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180288:0@lo:501: 00000100:00100000:2.0:1788390301.631720:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.631782:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.631812:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180288 00000100:00100000:3.0:1788390301.631816:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180288 00000100:00100000:3.0:1788390301.631872:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788390301.631880:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180288:12345-0@lo:501: 00000100:00100000:1.0:1788390301.632397:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180288:12345-0@lo:501: Request processed in 516us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390301.632405:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390301.632474:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180288:0@lo:501: 00000100:00100000:2.0:1788390301.632525:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180416:0@lo:503: 00000100:00100000:2.0:1788390301.632566:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.632808:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.632896:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180416 00000100:00100000:0.0:1788390301.632901:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180416 00000100:00100000:0.0:1788390301.632932:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390301.632946:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180416:12345-0@lo:503: 00000100:00100000:0.0:1788390301.633142:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180416:12345-0@lo:503: Request processed in 196us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.633149:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390301.633243:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180416:0@lo:503: 00000040:00080000:2.0:1788390301.633618:0:6648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390301.633699:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180544:0@lo:502: 00000100:00100000:2.0:1788390301.633736:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.633768:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.633828:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180544 00000100:00100000:0.0:1788390301.633860:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180544 00000100:00100000:0.0:1788390301.633881:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390301.633888:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180544:12345-0@lo:502: 00000100:00100000:0.0:1788390301.634131:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180544:12345-0@lo:502: Request processed in 242us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.634138:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390301.634346:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180544:0@lo:502: 00000040:00080000:2.0:1788390301.634701:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788390301.634750:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788390301.634795:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788390301.634868:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788390301.634915:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788390301.635011:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788390301.635045:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788390301.635086:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788390301.635131:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788390301.635178:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788390301.635225:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788390301.635280:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788390301.635328:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788390301.635369:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788390301.635416:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788390301.635457:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788390301.635494:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788390301.635705:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788390301.635744:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788390301.635786:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788390301.635847:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788390301.635886:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788390301.635927:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788390301.636128:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788390301.636163:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788390301.636203:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788390301.636263:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788390301.636301:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788390301.636351:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180672:0@lo:502: 00000100:00100000:2.0:1788390301.636424:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.636590:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390301.636675:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180672 00000100:00100000:3.0:1788390301.636681:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180672 00000100:00100000:0.0:1788390301.636735:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390301.636745:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180672:12345-0@lo:502: 00000100:00100000:0.0:1788390301.636925:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103180672:12345-0@lo:502: Request processed in 181us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390301.636932:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788390301.637043:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103180672:0@lo:502: 00000040:00080000:2.0:1788390301.637101:0:6648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788390301.637111:0:6648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788390301.637672:0:6671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788390301.637688:0:6671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d69180b370) 00000020:00000080:2.0:1788390301.637706:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788390301.637768:0:6671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d69fc01000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390301.637772:0:6671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d69fc01000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390301.637774:0:6671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d69fc01000 3 00010000:00080000:2.0:1788390301.637798:0:6671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6bcb32800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788390301.639678:0:6671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788390301.639907:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788390301.639947:0:6671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390301.639978:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd31b2c 00000100:00080000:2.0:1788390301.639986:0:6671:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390301.639991:0:6671:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d6bcb32800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390301.640022:0:6671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bcb2ed80 x1875263103180800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390301.640059:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103180800:0@lo:38: 00000100:00100000:2.0:1788390301.640119:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.640186:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180800 00000100:00100000:2.0:1788390301.640192:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180800 00000100:00100000:2.0:1788390301.640216:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390301.640222:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103180800:12345-0@lo:38: 00010000:00080000:2.0:1788390301.640240:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:2.0:1788390301.640273:0:5807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd31b33 00000004:00100000:2.0:1788390301.640288:0:5807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788390301.640314:0:5807:0:(import.c:65:import_set_state_nolock()) ffff95d69fc00800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390301.640355:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103180800:12345-0@lo:38: Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.640362:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390301.640395:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bcb2ed80 x1875263103180800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390301.640405:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390301.640411:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788390301.640417:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788390301.640420:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788390301.640422:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390301.640427:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103180800:0@lo:38: 00000100:00080000:2.0:1788390301.640449:0:6671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788390301.640577:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103180928:0@lo:400: 00000100:00100000:2.0:1788390301.640616:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.640655:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103180928 00000100:00100000:2.0:1788390301.640659:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103180928 00000100:00100000:2.0:1788390301.640683:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390301.640688:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103180928:12345-0@lo:400: 00000100:00100000:2.0:1788390301.640719:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103180928:12345-0@lo:400: Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.640725:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390301.640748:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bcb2ed80 x1875263103180928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390301.640757:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103180928:0@lo:400: 00000040:00080000:2.0:1788390301.640989:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788390301.642682:0:6648:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788390301.642712:0:6648:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390301.642740:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.642751:0:6648:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788390301.642797:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788390301.642800:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390301.642801:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390301.642802:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390301.642804:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390301.642805:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390301.642806:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390301.642808:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390301.642809:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390301.642811:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390301.642812:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390301.642816:0:6648:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788390301.642819:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390301.642820:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390301.642821:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390301.642822:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390301.642823:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390301.642824:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390301.642829:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390301.642830:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390301.642831:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390301.642831:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390301.642832:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390301.642851:0:6648:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788390301.642864:0:6648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103181056:0@lo:253: 00000100:00100000:1.0:1788390301.642920:0:6648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390301.642937:0:6648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390301.643622:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181056 00000100:00100000:0.0:1788390301.643630:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181056 00000100:00100000:0.0:1788390301.643680:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390301.643689:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6648:x1875263103181056:12345-0@lo:253: 20000000:01000000:0.0:1788390301.643712:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788390301.643725:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788390301.674013:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390301.674041:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788390301.674097:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788390301.674107:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788390301.674130:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.674155:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.674169:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.674212:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.674225:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 13 pid: 5799 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390301.674243:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103181184:0@lo:104: 00000100:00100000:3.0:1788390301.674309:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390301.674370:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390301.674610:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181184 00000100:00100000:1.0:1788390301.674618:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181184 00000100:00100000:1.0:1788390301.674675:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390301.674684:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103181184:12345-0@lo:104: 00010000:00010000:1.0:1788390301.674701:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390301.674751:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390301.674756:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103181184:12345-0@lo:104: Request processed in 74us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390301.674762:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390301.674900:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103181184:0@lo:104: 00010000:00010000:3.0:1788390301.674924:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.674940:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390301.674950:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.675046:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813dfc00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390301.675051:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.675058:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390301.675071:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390301.675077:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390301.675165:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.675172:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390301.675193:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.675199:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813dfc00/0x9aafc5f04cd31a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aa0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390301.675222:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.675224:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390301.675225:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390301.676793:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103181312:0@lo:103: 00000100:00100000:2.0:1788390301.676861:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390301.677030:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181312 00000100:00100000:2.0:1788390301.677042:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181312 00010000:00010000:2.0:1788390301.677071:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 14 pid: 5799 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390301.677097:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390301.677112:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3289:x1875263103181312:12345-0@lo:103: 00010000:00010000:2.0:1788390301.677124:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390301.677129:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 14 pid: 5799 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677161:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 14 pid: 5799 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677182:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31a99 expref: 14 pid: 5799 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677201:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677209:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390301.677230:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003124222s 00010000:00010000:2.0:1788390301.677235:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677242:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677248:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677260:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677265:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390301.677270:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677277:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677301:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677310:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390301.677352:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3289:x1875263103181312:12345-0@lo:103: Request processed in 235us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.677359:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788390301.677411:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677425:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390301.677432:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31b3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390301.677483:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103181312:0@lo:103: 00000100:00100000:3.0:1788390301.685138:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:6648:x1875263103181056:12345-0@lo:253: Request processed in 41442us (42210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390301.685157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390301.685293:0:6648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6648:1875263103181056:0@lo:253: 10000000:01000000:1.0:1788390301.685313:0:6648:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788390301.685317:0:6648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390301.685319:0:6648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390301.685320:0:6648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390301.685321:0:6648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390301.685322:0:6648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390301.685323:0:6648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390301.685325:0:6648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390301.685326:0:6648:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390301.685328:0:6648:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390301.685346:0:6648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390301.685348:0:6648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788390301.685364:0:6648:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788390301.689732:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390301.689893:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788390301.690143:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390301.690282:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788390301.690478:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390301.690800:0:6648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788390301.691763:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788390301.892778:0:6648:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788390301.892784:0:6648:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788390301.892813:0:6648:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788390301.892863:0:6648:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788390301.892878:0:6648:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788390301.892902:0:6648:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788390302.159605:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390303.181430:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788390303.696017:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788390303.696026:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a0d90000 from 21 10000000:01000000:2.0:1788390303.696031:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390303.696074:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390303.696086:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390303.696097:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390303.696120:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181440:0@lo:101: 00000100:00100000:2.0:1788390303.696192:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.696250:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.696305:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181440 00000100:00100000:1.0:1788390303.696313:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181440 00000100:00100000:1.0:1788390303.696356:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390303.696364:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103181440:12345-0@lo:101: 00010000:00010000:1.0:1788390303.696393:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390303.696406:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b41 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.696426:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.696434:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.696444:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813df200, rc 0) 00000100:00100000:1.0:1788390303.696497:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103181440:12345-0@lo:101: Request processed in 133us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.696503:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788390303.696652:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181440:0@lo:101: 00010000:00010000:2.0:1788390303.696665:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390303.696674:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390303.696719:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181568:0@lo:501: 00000100:00100000:2.0:1788390303.696745:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.696770:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.696852:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181568 00000100:00100000:1.0:1788390303.696857:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181568 00000100:00100000:1.0:1788390303.696890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390303.696896:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103181568:12345-0@lo:501: 00000100:00100000:1.0:1788390303.697258:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103181568:12345-0@lo:501: Request processed in 360us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.697267:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390303.697357:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181568:0@lo:501: 00000100:00100000:2.0:1788390303.697398:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181696:0@lo:503: 00000100:00100000:2.0:1788390303.697438:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.697455:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390303.697589:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181696 00000100:00100000:3.0:1788390303.697602:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181696 00000100:00100000:3.0:1788390303.697639:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390303.697647:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103181696:12345-0@lo:503: 00000100:00100000:3.0:1788390303.697919:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103181696:12345-0@lo:503: Request processed in 272us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390303.697926:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390303.697989:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103181696:0@lo:503: 00000100:00100000:3.0:1788390303.698157:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6750:1875263103181824:0@lo:502: 00000100:00100000:3.0:1788390303.698191:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390303.698209:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181824 00000100:00100000:3.0:1788390303.698213:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181824 00000100:00100000:3.0:1788390303.698230:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390303.698236:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6750:x1875263103181824:12345-0@lo:502: 00000100:00100000:2.0:1788390303.699023:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.706649:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6750:x1875263103181824:12345-0@lo:502: Request processed in 8401us (8446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.706662:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390303.707783:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6750:1875263103181824:0@lo:502: 00000100:00100000:3.0:1788390303.707853:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6750:1875263103181952:0@lo:502: 00000100:00100000:3.0:1788390303.707908:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390303.707943:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.708292:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103181952 00000100:00100000:1.0:1788390303.708300:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103181952 00000100:00100000:1.0:1788390303.708350:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390303.708359:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6750:x1875263103181952:12345-0@lo:502: 00000100:00100000:1.0:1788390303.708679:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:6750:x1875263103181952:12345-0@lo:502: Request processed in 320us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.708687:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390303.708768:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6750:1875263103181952:0@lo:502: 00000040:00080000:3.0:1788390303.708789:0:6750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788390303.709036:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788390303.709054:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390303.709063:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390303.709074:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390303.709083:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788390303.709085:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d6a0d90000 from 4 10000000:01000000:0.0:1788390303.709094:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788390303.709119:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390303.709127:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390303.709136:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390303.709149:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182080:0@lo:101: 00000100:00100000:0.0:1788390303.709179:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390303.709200:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.709554:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182080 00000100:00100000:1.0:1788390303.709560:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182080 00000100:00100000:1.0:1788390303.709609:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390303.709617:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103182080:12345-0@lo:101: 00010000:00010000:1.0:1788390303.709627:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390303.709640:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b4f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.709672:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.709682:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.709692:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813df600, rc 0) 00000100:00100000:1.0:1788390303.709726:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103182080:12345-0@lo:101: Request processed in 110us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.709733:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390303.709765:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182080:0@lo:101: 00010000:00010000:1.0:1788390303.709777:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.709786:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390303.709829:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182208:0@lo:256: 00000100:00100000:1.0:1788390303.709860:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.709873:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.709883:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182208 00000100:00100000:1.0:1788390303.709887:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182208 00000100:00100000:1.0:1788390303.709907:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390303.709913:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103182208:12345-0@lo:256: 20000000:01000000:1.0:1788390303.709924:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390303.709940:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390303.709943:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788390303.710049:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103182208:12345-0@lo:256: Request processed in 135us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.710056:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390303.710084:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182208:0@lo:256: 10000000:01000000:1.0:1788390303.710122:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788390303.710127:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710135:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390303.710142:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788390303.710144:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788390303.710147:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390303.710161:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710168:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710176:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390303.710188:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182336:0@lo:101: 00000100:00100000:1.0:1788390303.710214:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.710227:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.710238:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182336 00000100:00100000:1.0:1788390303.710241:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182336 00000100:00100000:1.0:1788390303.710259:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390303.710265:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103182336:12345-0@lo:101: 00010000:00010000:1.0:1788390303.710277:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390303.710286:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b5d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710300:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710308:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710314:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813df800, rc 0) 00000100:00100000:1.0:1788390303.710343:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103182336:12345-0@lo:101: Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.710349:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390303.710640:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182336:0@lo:101: 00010000:00010000:1.0:1788390303.710652:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.710660:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390303.710700:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182464:0@lo:501: 00000100:00100000:1.0:1788390303.710725:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.710785:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390303.713630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182464 00000100:00100000:0.0:1788390303.713644:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182464 00000100:00100000:0.0:1788390303.713702:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390303.713712:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103182464:12345-0@lo:501: 00000100:00100000:0.0:1788390303.714029:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103182464:12345-0@lo:501: Request processed in 319us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390303.714038:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390303.716118:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182464:0@lo:501: 00000100:00100000:0.0:1788390303.716168:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182592:0@lo:503: 00000100:00100000:0.0:1788390303.716229:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390303.716296:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390303.716358:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182592 00000100:00100000:3.0:1788390303.716364:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182592 00000100:00100000:3.0:1788390303.716424:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390303.716434:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103182592:12345-0@lo:503: 00000100:00100000:3.0:1788390303.716778:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103182592:12345-0@lo:503: Request processed in 345us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390303.716795:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390303.716843:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103182592:0@lo:503: 00000100:00100000:3.0:1788390303.717031:0:6753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6753:1875263103182720:0@lo:502: 00000100:00100000:3.0:1788390303.717062:0:6753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390303.717082:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182720 00000100:00100000:3.0:1788390303.717086:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182720 00000100:00100000:3.0:1788390303.717102:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788390303.717108:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:6753:x1875263103182720:12345-0@lo:502: 00000100:00100000:3.0:1788390303.717281:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:6753:x1875263103182720:12345-0@lo:502: Request processed in 172us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390303.717287:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788390303.717313:0:6753:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390303.717323:0:6753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6753:1875263103182720:0@lo:502: 00000020:01000000:3.0:1788390303.717341:0:6753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390303.717348:0:6753:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788390303.717354:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390303.717357:0:6753:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788390303.717362:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390303.717365:0:6753:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1788390303.717387:0:6753:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788390303.717390:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390303.717402:0:6753:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95d68a8ecd28) 00000020:00000080:3.0:1788390303.717419:0:6753:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788390303.717425:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390303.717496:0:6753:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788390303.717501:0:6753:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788390303.717506:0:6753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd31b72 00010000:00080000:3.0:1788390303.717536:0:6753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d685278800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788390303.723268:0:6753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788390303.767795:0:6753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788390303.767818:0:6753:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788390303.771406:0:6753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390303.771677:0:6753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390303.771726:0:6753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788390303.771801:0:6753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788390303.772618:0:6757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390303.772623:0:6757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788390303.773240:0:6753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390303.773252:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788390303.773286:0:6753:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788390303.773306:0:6753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd31b79 00000100:00080000:1.0:1788390303.773316:0:6753:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390303.773322:0:6753:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d685278800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390303.773356:0:6753:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d682f2a680 x1875263103182848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390303.773392:0:6753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788390303.773453:0:6753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390303.773457:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390303.773459:0:6753:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788390303.773461:0:6753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390303.773465:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390303.773466:0:6753:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390303.773469:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390303.773471:0:6753:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788390303.773619:0:6753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6753:1875263103182976:0@lo:502: 00000100:00100000:1.0:1788390303.773694:0:6753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.773740:0:6753:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.773763:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182976 00000100:00100000:1.0:1788390303.773769:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182976 00000100:00100000:1.0:1788390303.773805:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390303.773814:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:6753:x1875263103182976:12345-0@lo:502: 00000100:00100000:1.0:1788390303.774022:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:6753:x1875263103182976:12345-0@lo:502: Request processed in 208us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.774039:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390303.774089:0:6753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:6753:1875263103182976:0@lo:502: 00000020:01000000:1.0:1788390303.774113:0:6753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390303.774118:0:6753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390303.774119:0:6753:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788390303.774122:0:6753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788390303.774214:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788390303.774229:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788390303.774238:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774248:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390303.774258:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788390303.774260:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d68a8e99b8 from 1 10000000:01000000:1.0:1788390303.774264:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788390303.774285:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774294:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774303:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390303.774314:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103183104:0@lo:101: 00000100:00100000:1.0:1788390303.774338:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.774351:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.774370:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183104 00000100:00100000:1.0:1788390303.774443:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183104 00000100:00100000:1.0:1788390303.774468:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390303.774474:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103183104:12345-0@lo:101: 00010000:00010000:1.0:1788390303.774545:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390303.774556:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31b80 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774588:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774597:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774606:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813de400, rc 0) 00000100:00100000:1.0:1788390303.774636:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103183104:12345-0@lo:101: Request processed in 161us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.774642:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390303.774685:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103183104:0@lo:101: 00010000:00010000:1.0:1788390303.774698:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.774706:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390303.774746:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103183232:0@lo:501: 00000100:00100000:1.0:1788390303.774769:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.774782:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.774793:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183232 00000100:00100000:1.0:1788390303.774804:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183232 00000100:00100000:1.0:1788390303.774824:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390303.774829:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103183232:12345-0@lo:501: 00000100:00100000:1.0:1788390303.775028:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103183232:12345-0@lo:501: Request processed in 198us (257us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390303.775035:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390303.775066:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103183232:0@lo:501: 10000000:01000000:1.0:1788390303.775084:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788390303.775089:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390303.775096:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390303.775176:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103182848:0@lo:8: 00000100:00100000:3.0:1788390303.775219:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.775643:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103183488:0@lo:400: 00000100:00100000:2.0:1788390303.775678:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.775700:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390303.775706:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103183360:0@lo:400: 00000100:00100000:2.0:1788390303.775730:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.775757:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183488 00000100:00100000:2.0:1788390303.775762:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183488 00000100:00100000:2.0:1788390303.775803:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183360 00000100:00100000:2.0:1788390303.775806:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183360 00000100:00100000:2.0:1788390303.775820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390303.775833:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103183488:12345-0@lo:400: 00000100:00100000:2.0:1788390303.775870:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103183488:12345-0@lo:400: Request processed in 38us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390303.775876:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390303.775889:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390303.775894:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103183360:12345-0@lo:400: 00000100:00100000:2.0:1788390303.775919:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103183360:12345-0@lo:400: Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390303.775924:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390303.775953:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bcb2ed80 x1875263103183360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390303.775981:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103183360:0@lo:400: 00010000:00080000:2.0:1788390303.775991:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bcb2f800 x1875263103183488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390303.775999:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103183488:0@lo:400: 00000100:00100000:1.0:1788390303.776152:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103182848 00000100:00100000:1.0:1788390303.776157:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103182848 00000100:00100000:1.0:1788390303.776222:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390303.776228:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103182848:12345-0@lo:8: 00010000:00080000:1.0:1788390303.776249:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:1.0:1788390303.776273:0:6650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd31b8e 00002000:00100000:1.0:1788390303.776310:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d585124000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788390303.776314:0:6650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788390303.776317:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788390303.776421:0:6650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390303.776711:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390303.776734:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d585120800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390303.776786:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103182848:12345-0@lo:8: Request processed in 557us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390303.776799:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788390303.776860:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682f2a680 x1875263103182848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390303.776869:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390303.776875:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788390303.776882:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788390303.776887:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788390303.776889:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d685278800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788390303.776903:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788390303.776907:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103182848:0@lo:8: 00000100:00080000:0.0:1788390303.777093:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788390303.783924:0:6757:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788390303.784178:0:6757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 120891216551ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788390303.856073:0:6758:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788390303.856101:0:6758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103183744:0@lo:7: 00000100:00100000:3.0:1788390303.856163:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390303.856208:0:6758:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390303.856234:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183744 00000100:00100000:3.0:1788390303.856240:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183744 00000100:00100000:3.0:1788390303.856297:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390303.856308:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6758:x1875263103183744:12345-0@lo:7: 00000100:00100000:2.0:1788390303.858315:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103183616:0@lo:13: 00000100:00100000:2.0:1788390303.858387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390303.859025:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183616 00000100:00100000:2.0:1788390303.859032:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183616 00000100:00100000:2.0:1788390303.859072:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390303.859081:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103183616:12345-0@lo:13: 00002000:00000024:2.0:1788390303.859109:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788390303.859156:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103183616:12345-0@lo:13: Request processed in 77us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390303.859163:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788390303.859203:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e95c00 x1875263103183616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390303.859221:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103183616:0@lo:13: 00000100:00080000:3.0:1788390303.864651:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788390303.881318:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788390303.881326:0:6653:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788390303.881414:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6758:x1875263103183744:12345-0@lo:7: Request processed in 25104us (25246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390303.881424:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788390303.881475:0:6758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e95180 x1875263103183744/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390319 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390303.881491:0:6758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103183744:0@lo:7: 00000004:00080000:3.0:1788390303.881504:0:6758:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788390303.881539:0:6758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103183872:0@lo:5: 00000100:00100000:3.0:1788390303.881570:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.884778:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103183872 00000100:00100000:1.0:1788390303.884790:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103183872 00000100:00100000:1.0:1788390303.884841:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390303.884852:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6758:x1875263103183872:12345-0@lo:5: 00002000:00080000:1.0:1788390303.884883:0:6650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788390303.884888:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788390303.886536:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6758:x1875263103183872:12345-0@lo:5: Request processed in 1684us (4963us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788390303.886546:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390303.892122:0:6758:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228000 going to sleep for 11 seconds 00010000:00080000:3.0:1788390303.892163:0:6758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e95180 x1875263103183872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390319 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390303.892179:0:6758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103183872:0@lo:5: 00000004:00080000:3.0:1788390303.892201:0:6758:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788390303.892239:0:6758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103184000:0@lo:700: 00000100:00100000:3.0:1788390303.892292:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390303.892324:0:6758:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390303.893307:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184000 00000100:00100000:1.0:1788390303.893315:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184000 00000100:00100000:1.0:1788390303.893358:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390303.893367:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6758:x1875263103184000:12345-0@lo:700: 00000100:00100000:1.0:1788390303.893622:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6659:1875263103184128:0@lo:700: 00000100:00100000:1.0:1788390303.893679:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390303.893708:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d691579900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390303.894596:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184128 00000100:00100000:3.0:1788390303.894603:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184128 00000100:00100000:3.0:1788390303.894642:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390303.894651:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6659:x1875263103184128:12345-0@lo:700: 00000004:00080000:3.0:1788390303.909401:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788390303.978869:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788390304.006465:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6659:x1875263103184128:12345-0@lo:700: Request processed in 111806us (112777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390304.006498:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788390304.006554:0:6659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682f28e00 x1875263103184128/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788390319 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390304.006569:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6659:1875263103184128:0@lo:700: 40000000:02000000:2.0:1788390304.006591:0:6659:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788390304.132869:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788390304.132892:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788390304.133163:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6758:x1875263103184000:12345-0@lo:700: Request processed in 239792us (240866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390304.133179:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788390304.133318:0:6758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e97480 x1875263103184000/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390319 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390304.133328:0:6758:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788390304.133344:0:6758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103184000:0@lo:700: 00010000:00010000:0.0:1788390304.210215:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1788390304.210238:0:6758:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788390304.226817:0:6758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103184256:0@lo:5: 00000100:00100000:0.0:1788390304.228151:0:6758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390304.228317:0:6758:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390304.228480:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184256 00000100:00100000:3.0:1788390304.228489:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184256 00000100:00100000:3.0:1788390304.228542:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390304.228552:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6758:x1875263103184256:12345-0@lo:5: 00002000:00080000:3.0:1788390304.246254:0:6650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788390304.246274:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788390304.252120:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6758:x1875263103184256:12345-0@lo:5: Request processed in 23564us (23966us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788390304.252132:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788390304.252284:0:6758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691832a00 x1875263103184256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390304.252303:0:6758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6758:1875263103184256:0@lo:5: 00000004:00080000:0.0:1788390304.252317:0:6758:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788390305.234158:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390306.256060:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390307.279029:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390308.301408:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390308.378858:0:7019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788390308.819370:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103184768:0@lo:400: 00000100:00100000:3.0:1788390308.819452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390308.819506:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390308.819523:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103184384:0@lo:400: 00000100:00100000:3.0:1788390308.819565:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390308.819594:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103184512:0@lo:400: 00000100:00100000:3.0:1788390308.819621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390308.819639:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390308.819644:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103184640:0@lo:400: 00000100:00100000:3.0:1788390308.819669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390308.819699:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184768 00000100:00100000:3.0:1788390308.819707:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184768 00000100:00100000:3.0:1788390308.819764:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390308.819774:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103184768:12345-0@lo:400: 00000100:00100000:3.0:1788390308.819822:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103184768:12345-0@lo:400: Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390308.819829:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390308.819851:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184512 00000100:00100000:3.0:1788390308.819854:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184512 00000100:00100000:3.0:1788390308.819875:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184640 00000100:00100000:3.0:1788390308.819878:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184640 00000100:00100000:3.0:1788390308.819894:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390308.819900:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103184512:12345-0@lo:400: 00000100:00100000:3.0:1788390308.819932:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103184512:12345-0@lo:400: Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390308.819938:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390308.819949:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390308.819956:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103184640:12345-0@lo:400: 00000100:00100000:1.0:1788390308.820080:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184384 00000100:00100000:1.0:1788390308.820084:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184384 00000100:00100000:1.0:1788390308.820113:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390308.820119:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3288:x1875263103184384:12345-0@lo:400: 00000100:00100000:1.0:1788390308.820152:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3288:x1875263103184384:12345-0@lo:400: Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390308.820158:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390308.820365:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103184640:12345-0@lo:400: Request processed in 410us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390308.820380:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788390308.820400:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390308.820405:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390308.820489:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e94380 x1875263103184640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390308.820503:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103184640:0@lo:400: 00010000:00080000:3.0:1788390308.820516:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e94a80 x1875263103184512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390308.820524:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103184512:0@lo:400: 00000100:00100000:3.0:1788390308.820637:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103184384:0@lo:400: 00010000:00080000:3.0:1788390308.820648:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e96a00 x1875263103184768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390308.820657:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103184768:0@lo:400: 00000100:00100000:1.0:1788390309.325270:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103184896:0@lo:13: 00000100:00100000:1.0:1788390309.325332:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390309.325417:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103184896 00000100:00100000:1.0:1788390309.325424:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103184896 00000100:00100000:1.0:1788390309.325470:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390309.325477:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103184896:12345-0@lo:13: 00002000:00000024:1.0:1788390309.325507:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390309.325558:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103184896:12345-0@lo:13: Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.325565:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788390309.325602:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682f2aa00 x1875263103184896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390309.325619:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103184896:0@lo:13: 00010000:00010000:3.0:1788390309.329441:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788390309.408675:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788390310.349299:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390311.374122:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390312.399605:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390313.421150:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390313.934189:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103185280:0@lo:400: 00000100:00100000:0.0:1788390313.934278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390313.934334:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390313.934341:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103185408:0@lo:400: 00000100:00100000:0.0:1788390313.934368:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390313.934427:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185280 00000100:00100000:0.0:1788390313.934434:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185280 00000100:00100000:0.0:1788390313.934503:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390313.934513:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103185280:12345-0@lo:400: 00000100:00100000:0.0:1788390313.934568:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103185280:12345-0@lo:400: Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390313.934576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788390313.934599:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788390313.934629:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691833480 x1875263103185280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390313.934644:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103185280:0@lo:400: 00000100:00100000:3.0:1788390313.934783:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103185024:0@lo:400: 00000100:00100000:3.0:1788390313.934818:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390313.934849:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390313.934855:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103185152:0@lo:400: 00000100:00100000:3.0:1788390313.934879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390313.934904:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185408 00000100:00100000:3.0:1788390313.934908:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185408 00000100:00100000:3.0:1788390313.934941:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390313.934957:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103185408:12345-0@lo:400: 00000100:00100000:3.0:1788390313.935021:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103185408:12345-0@lo:400: Request processed in 66us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390313.935028:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390313.935048:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185152 00000100:00100000:3.0:1788390313.935051:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185152 00000100:00100000:3.0:1788390313.935070:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390313.935077:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103185152:12345-0@lo:400: 00000100:00100000:3.0:1788390313.935110:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103185152:12345-0@lo:400: Request processed in 33us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390313.935117:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788390313.935144:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691831500 x1875263103185152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390313.935154:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103185152:0@lo:400: 00000100:00100000:0.0:1788390313.935287:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185024 00000100:00100000:0.0:1788390313.935291:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185024 00000100:00100000:0.0:1788390313.935328:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788390313.935336:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103185024:12345-0@lo:400: 00000100:00100000:0.0:1788390313.935373:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103185024:12345-0@lo:400: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390313.935379:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788390313.935472:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390313.935499:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103185024:0@lo:400: 00010000:00080000:0.0:1788390313.935526:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691833b80 x1875263103185408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390313.935534:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788390313.935544:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103185408:0@lo:400: 00000100:00100000:1.0:1788390314.445109:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390314.445134:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103185536:0@lo:13: 00000100:00100000:1.0:1788390314.445198:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390314.445247:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185536 00000100:00100000:2.0:1788390314.445256:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185536 00000100:00100000:2.0:1788390314.445311:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390314.445321:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103185536:12345-0@lo:13: 00002000:00000024:2.0:1788390314.445366:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390314.445415:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103185536:12345-0@lo:13: Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390314.445422:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390314.445460:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682f2aa00 x1875263103185536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390314.445492:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103185536:0@lo:13: 00010000:00010000:0.0:1788390314.445624:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390315.475393:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390316.493345:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390317.521693:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390318.543672:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390319.053724:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103185792:0@lo:400: 00000100:00100000:3.0:1788390319.053807:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.053862:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390319.053869:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103185920:0@lo:400: 00000100:00100000:3.0:1788390319.053893:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.054005:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185792 00000100:00100000:3.0:1788390319.054025:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185792 00000100:00100000:3.0:1788390319.054115:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185920 00000100:00100000:3.0:1788390319.054119:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185920 00000100:00100000:3.0:1788390319.054164:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390319.054204:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103185792:12345-0@lo:400: 00000100:00100000:3.0:1788390319.054319:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103185792:12345-0@lo:400: Request processed in 147us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.054327:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390319.054345:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390319.054352:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103185920:12345-0@lo:400: 00000100:00100000:3.0:1788390319.054377:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103185920:12345-0@lo:400: Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.054383:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788390319.054405:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788390319.054431:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e94380 x1875263103185920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390319.054455:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103185920:0@lo:400: 00010000:00080000:3.0:1788390319.054466:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e94a80 x1875263103185792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390319.054475:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103185792:0@lo:400: 00000100:00100000:2.0:1788390319.054553:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103185664:0@lo:400: 00000100:00100000:2.0:1788390319.054589:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.054628:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390319.054635:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103186048:0@lo:400: 00000100:00100000:2.0:1788390319.054659:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.054695:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186048 00000100:00100000:2.0:1788390319.054699:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186048 00000100:00100000:2.0:1788390319.054733:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390319.054739:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103186048:12345-0@lo:400: 00000100:00100000:2.0:1788390319.054772:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103186048:12345-0@lo:400: Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.054777:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788390319.054791:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390319.054808:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682e97480 x1875263103186048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390319.054818:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103186048:0@lo:400: 00000100:00100000:3.0:1788390319.056926:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103185664 00000100:00100000:3.0:1788390319.056940:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103185664 00000100:00100000:3.0:1788390319.057160:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390319.057171:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3287:x1875263103185664:12345-0@lo:400: 00000100:00100000:3.0:1788390319.057252:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3287:x1875263103185664:12345-0@lo:400: Request processed in 84us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.057260:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390319.063718:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103185664:0@lo:400: 00000100:00100000:2.0:1788390319.565146:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103186176:0@lo:13: 00000100:00100000:2.0:1788390319.565211:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390319.565268:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390319.565278:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186176 00000100:00100000:2.0:1788390319.565284:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186176 00000100:00100000:2.0:1788390319.565325:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390319.565333:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103186176:12345-0@lo:13: 00002000:00000024:2.0:1788390319.565376:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390319.565416:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103186176:12345-0@lo:13: Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.565423:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390319.565471:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bcb2c380 x1875263103186176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390319.565489:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103186176:0@lo:13: 00000020:01000004:1.0:1788390319.590166:0:7583:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390319.590170:0:7583:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788390319.590653:0:7583:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d6a6b1a000 00000020:01000004:1.0:1788390319.590668:0:7583:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788390319.590699:0:7583:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390319.590712:0:7583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d68a663370) 00000020:00000080:1.0:1788390319.590731:0:7583:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788390319.608302:0:7583:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788390319.608725:0:7583:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788390319.631706:0:7583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788390319.642703:0:7583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788390319.642734:0:7583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788390319.642786:0:7583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390319.642825:0:7583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788390319.646827:0:7583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788390319.646846:0:7583:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390319.646857:0:7583:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd31b9c 00000020:01000004:1.0:1788390319.647693:0:7583:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788390319.647717:0:7583:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390319.647721:0:7583:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390319.647727:0:7583:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788390319.647753:0:7583:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788390319.647757:0:7583:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788390319.679798:0:7583:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390319.679835:0:7583:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788390319.679839:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390319.679841:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390319.679845:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390319.679846:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390319.679847:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390319.679848:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390319.679850:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390319.679851:0:7583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390319.679852:0:7583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390319.679854:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390319.679855:0:7583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390319.679858:0:7583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788390319.679860:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390319.679861:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390319.679862:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390319.679863:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390319.679864:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390319.679865:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390319.679866:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390319.679867:0:7583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390319.679868:0:7583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390319.679869:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390319.679869:0:7583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390319.679896:0:7583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788390319.679913:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103186304:0@lo:253: 00000100:00100000:0.0:1788390319.680106:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.680198:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390319.680239:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186304 00000100:00100000:3.0:1788390319.680246:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186304 00000100:00100000:3.0:1788390319.680328:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390319.680347:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:7583:x1875263103186304:12345-0@lo:253: 20000000:01000000:3.0:1788390319.680379:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788390319.680383:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788390319.680388:0:5801:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788390319.680391:0:5801:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788390319.681542:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390319.681769:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788390319.681783:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788390319.681824:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788390319.681831:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788390319.681861:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788390319.681911:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788390319.682577:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788390319.682597:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:3.0:1788390319.682600:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788390319.682634:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788390319.682642:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788390319.682686:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788390319.682694:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:3.0:1788390319.682739:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788390319.682748:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788390319.682783:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788390319.682835:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788390319.684743:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788390319.684768:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:3.0:1788390319.684771:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788390319.684805:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788390319.684813:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788390319.684843:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788390319.684850:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:3.0:1788390319.684880:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788390319.684889:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788390319.684946:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788390319.685569:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788390319.685594:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788390319.685598:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788390319.685604:0:5801:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788390319.685606:0:5801:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788390319.685608:0:5801:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788390319.685623:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788390319.685626:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788390319.685670:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788390319.685672:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788390319.687396:0:7585:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788390319.687511:0:7585:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788390319.687549:0:7585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788390319.687901:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788390319.687946:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788390319.688669:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788390319.688688:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788390319.688690:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390319.689459:0:7586:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390319.689509:0:7586:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390319.689556:0:7586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788390319.689865:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788390319.689905:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788390319.690016:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788390319.690030:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788390319.690032:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788390319.706597:0:7587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788390319.708896:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788390319.708945:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788390319.709217:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788390319.709233:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788390319.709237:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788390319.710427:0:7588:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788390319.710495:0:7588:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788390319.710543:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788390319.710813:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788390319.710851:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788390319.710886:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1788390319.710900:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788390319.710916:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.710932:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.710949:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.710955:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711002:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711009:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711015:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711073:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711086:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 16 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.711100:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186432:0@lo:104: 00000100:00100000:3.0:1788390319.711164:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390319.711211:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711220:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 16 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.711229:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186560:0@lo:104: 00010000:00010000:3.0:1788390319.711262:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711270:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 16 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.711277:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186688:0@lo:104: 00010000:00010000:3.0:1788390319.711299:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711308:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 16 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.711315:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186816:0@lo:104: 00010000:00010000:3.0:1788390319.711362:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.711370:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 16 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.711378:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc743b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186944:0@lo:104: 00000100:00100000:3.0:1788390319.711397:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390319.711572:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788390319.711590:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.711614:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.711630:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.711640:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.711650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186432 00000100:00100000:1.0:1788390319.711657:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186432 00000100:00100000:1.0:1788390319.711687:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186560 00000100:00100000:1.0:1788390319.711690:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186560 00000100:00100000:1.0:1788390319.711699:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186688 00000100:00100000:1.0:1788390319.711700:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186688 00000100:00100000:1.0:1788390319.711708:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186816 00000100:00100000:1.0:1788390319.711710:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186816 00000100:00100000:1.0:1788390319.711717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103186944 00000100:00100000:1.0:1788390319.711719:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103186944 00000100:00100000:1.0:1788390319.711731:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390319.711740:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686884450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:5801:x1875263103186432:12345-0@lo:104: 00010000:00010000:1.0:1788390319.711752:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.711821:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390319.711827:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686884450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:5801:x1875263103186432:12345-0@lo:104: Request processed in 89us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.711834:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390319.711879:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390319.711885:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5801:x1875263103186560:12345-0@lo:104: 00010000:00010000:1.0:1788390319.711892:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.711923:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788390319.711928:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:5801:x1875263103186560:12345-0@lo:104: Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.711934:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390319.711946:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390319.711951:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:5801:x1875263103186688:12345-0@lo:104: 00010000:00010000:1.0:1788390319.711978:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712004:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788390319.712009:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:5801:x1875263103186688:12345-0@lo:104: Request processed in 59us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.712015:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390319.712026:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390319.712030:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:5801:x1875263103186816:12345-0@lo:104: 00000100:00100000:2.0:1788390319.712171:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186432:0@lo:104: 00000100:00100000:2.0:1788390319.712180:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186560:0@lo:104: 00000100:00100000:2.0:1788390319.712186:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186688:0@lo:104: 00010000:00010000:1.0:1788390319.712227:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712271:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788390319.712276:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:5801:x1875263103186816:12345-0@lo:104: Request processed in 246us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.712283:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390319.712294:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390319.712300:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103186944:12345-0@lo:104: 00010000:00010000:1.0:1788390319.712305:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712327:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788390319.712429:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186816:0@lo:104: 00000100:00100000:2.0:1788390319.712449:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc743b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5801:1875263103186944:0@lo:104: 00010000:00010000:2.0:1788390319.712473:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.712507:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5801:x1875263103186944:12345-0@lo:104: Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.712515:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788390319.712532:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788390319.712537:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712544:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813dec00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.712548:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712556:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.712562:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.712567:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390319.712646:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712654:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390319.712671:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712678:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813dec00/0x9aafc5f04cd31b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712690:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788390319.712693:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712698:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813de000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.712701:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.712707:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.712712:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.712717:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788390319.712776:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187072:0@lo:103: 00000100:00100000:3.0:1788390319.712808:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.712850:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187072 00000100:00100000:3.0:1788390319.712855:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187072 00010000:00010000:3.0:1788390319.712873:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 17 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.712908:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390319.712916:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3288:x1875263103187072:12345-0@lo:103: 00010000:00010000:3.0:1788390319.712926:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390319.712932:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 17 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.712941:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 17 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.712954:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b80 expref: 17 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.712981:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390319.713010:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3288:x1875263103187072:12345-0@lo:103: Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.713017:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390319.713057:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187072:0@lo:103: 00010000:00010000:1.0:1788390319.713604:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713612:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788390319.713658:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788390319.713738:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713756:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713766:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788390319.713769:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713775:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdca00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.713779:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713786:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.713792:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.713799:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390319.713823:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713829:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390319.713851:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713859:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b48 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713868:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390319.713877:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713882:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.713885:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713891:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.713897:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.713902:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390319.713913:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713919:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390319.713924:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713931:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b1e expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713941:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390319.713944:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713949:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.713952:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.713990:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.713997:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.714002:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390319.714014:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.714019:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788390319.714070:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103187328:0@lo:103: 00000100:00100000:3.0:1788390319.714106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.714137:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390319.714143:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103187456:0@lo:103: 00000100:00100000:3.0:1788390319.714162:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.714185:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187328 00000100:00100000:3.0:1788390319.714189:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187328 00010000:00010000:3.0:1788390319.714210:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 16 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.714241:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187456 00000100:00100000:3.0:1788390319.714244:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187456 00010000:00010000:3.0:1788390319.714256:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 17 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.714269:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390319.714276:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3286:x1875263103187328:12345-0@lo:103: 00010000:00010000:3.0:1788390319.714285:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390319.714290:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 17 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714298:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 17 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714310:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813df200/0x9aafc5f04cd31b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b41 expref: 17 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714321:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390319.714363:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103187328:12345-0@lo:103: Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.714370:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390319.714384:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390319.714390:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3286:x1875263103187456:12345-0@lo:103: 00010000:00010000:3.0:1788390319.714397:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390319.714400:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 15 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714408:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 15 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714423:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b17 expref: 15 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.714443:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390319.714466:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3286:x1875263103187456:12345-0@lo:103: Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.714472:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390319.714501:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103187456:0@lo:103: 00000100:00100000:3.0:1788390319.714509:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103187328:0@lo:103: 00000100:00100000:0.0:1788390319.714996:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187584:0@lo:103: 00000100:00100000:0.0:1788390319.715026:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.715054:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187200:0@lo:103: 00000100:00100000:0.0:1788390319.715084:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.715155:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187584 00000100:00100000:3.0:1788390319.715160:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187584 00010000:00010000:3.0:1788390319.715177:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.715204:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187200 00000100:00100000:3.0:1788390319.715208:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187200 00010000:00010000:3.0:1788390319.715220:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390319.715234:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390319.715240:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3288:x1875263103187584:12345-0@lo:103: 00010000:00010000:3.0:1788390319.715247:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390319.715251:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715260:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715281:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd31af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31aed expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715291:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390319.715320:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103187584:12345-0@lo:103: Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.715328:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390319.715342:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390319.715348:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103187200:12345-0@lo:103: 00010000:00010000:3.0:1788390319.715355:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390319.715359:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715368:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715377:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813df800/0x9aafc5f04cd31b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b5d expref: 13 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715388:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715394:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715407:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715415:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715428:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715464:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715470:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390319.715474:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715481:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715496:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715506:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390319.715559:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3288:x1875263103187200:12345-0@lo:103: Request processed in 211us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.715566:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390319.715592:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187584:0@lo:103: 00000100:00100000:3.0:1788390319.715600:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103187200:0@lo:103: 00010000:00010000:3.0:1788390319.715619:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715626:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.715633:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31ba3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788390319.715652:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1788390319.721702:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.721720:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd31aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31af4 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.721750:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390319.721879:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390319.721881:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390319.721883:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390319.767895:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:7583:x1875263103186304:12345-0@lo:253: Request processed in 87549us (87780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.767911:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390319.768023:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103186304:0@lo:253: 10000000:01000000:0.0:1788390319.768040:0:7583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788390319.768044:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390319.768045:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390319.768047:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390319.768048:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788390319.768049:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390319.768050:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390319.768051:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390319.768053:0:7583:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788390319.768054:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390319.768056:0:7583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390319.768079:0:7583:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d6a6b1a000 from lustre-OST0001 10000000:01000000:0.0:1788390319.768106:0:7583:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788390319.768109:0:7583:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788390319.768116:0:7583:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d68a8e99b8 local copy 10000000:01000000:0.0:1788390319.768121:0:7583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788390319.768161:0:7583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.768174:0:7583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.768186:0:7583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390319.768205:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187712:0@lo:101: 00000100:00100000:0.0:1788390319.768243:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.768281:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390319.768341:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187712 00000100:00100000:3.0:1788390319.768348:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187712 00000100:00100000:3.0:1788390319.768384:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788390319.768391:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+11:7583:x1875263103187712:12345-0@lo:101: 00010000:00010000:3.0:1788390319.768403:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390319.768416:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31baa expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.768447:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31baa expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.768457:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31baa expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.768466:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390319.768503:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103187712:12345-0@lo:101: Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.768509:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390319.768576:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187712:0@lo:101: 00010000:00010000:0.0:1788390319.768588:0:7583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.768609:0:7583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390319.768710:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187840:0@lo:501: 00000100:00100000:0.0:1788390319.768734:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.768759:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390319.768879:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187840 00000100:00100000:2.0:1788390319.768890:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187840 00000100:00100000:2.0:1788390319.768922:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788390319.768929:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103187840:12345-0@lo:501: 00000100:00100000:2.0:1788390319.769144:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103187840:12345-0@lo:501: Request processed in 215us (409us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390319.769151:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390319.769224:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187840:0@lo:501: 10000000:01000000:0.0:1788390319.769238:0:7583:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788390319.769263:0:7583:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788390319.769267:0:7583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769276:0:7583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769283:0:7583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769308:0:7583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788390319.769331:0:7583:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6a6b1a000 10000000:01000000:0.0:1788390319.769336:0:7583:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788390319.769342:0:7583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788390319.769344:0:7583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390319.769348:0:7583:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788390319.769351:0:7583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788390319.769368:0:7583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769385:0:7583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769393:0:7583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390319.769404:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187968:0@lo:101: 00000100:00100000:0.0:1788390319.769438:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.769459:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390319.769517:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103187968 00000100:00100000:3.0:1788390319.769522:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103187968 00000100:00100000:3.0:1788390319.769554:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788390319.769561:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103187968:12345-0@lo:101: 00010000:00010000:3.0:1788390319.769568:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390319.769582:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31bb8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.769597:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.769605:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.769613:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390319.769636:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103187968:12345-0@lo:101: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.769642:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390319.769712:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103187968:0@lo:101: 00010000:00010000:0.0:1788390319.769721:0:7583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.769728:0:7583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390319.769779:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188096:0@lo:501: 00000100:00100000:0.0:1788390319.769802:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.769821:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788390319.769929:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390319.769935:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.769942:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390319.769946:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.769954:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390319.769988:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390319.769994:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390319.770012:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.770018:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390319.770034:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.770041:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680031200/0x9aafc5f04cd31baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9aafc5f04cd31bb1 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.770063:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390319.770065:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390319.770067:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390319.770075:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390319.770086:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103188224:0@lo:103: 00000100:00100000:2.0:1788390319.770112:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.770140:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188224 00000100:00100000:2.0:1788390319.770144:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188224 00000100:00100000:2.0:1788390319.770169:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390319.770175:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103188224:12345-0@lo:103: 00010000:00010000:2.0:1788390319.770183:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390319.770193:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31baa expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.770202:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390319.770223:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3288:x1875263103188224:12345-0@lo:103: Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.770229:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390319.770251:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103188224:0@lo:103: 00000100:00100000:2.0:1788390319.770264:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188096 00000100:00100000:2.0:1788390319.770267:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188096 00000100:00100000:2.0:1788390319.770281:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788390319.770285:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188096:12345-0@lo:501: 00000100:00100000:2.0:1788390319.770454:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188096:12345-0@lo:501: Request processed in 168us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.770461:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788390319.770680:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188096:0@lo:501: 00000100:00100000:0.0:1788390319.770705:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188352:0@lo:503: 00000100:00100000:0.0:1788390319.770739:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.770763:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390319.770810:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188352 00000100:00100000:2.0:1788390319.770814:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188352 00000100:00100000:2.0:1788390319.770843:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788390319.770850:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188352:12345-0@lo:503: 00000100:00100000:2.0:1788390319.771164:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188352:12345-0@lo:503: Request processed in 314us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.771171:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390319.771390:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188352:0@lo:503: 00000040:00080000:0.0:1788390319.771644:0:7583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390319.771706:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188480:0@lo:502: 00000100:00100000:0.0:1788390319.771740:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.771807:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390319.771849:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188480 00000100:00100000:2.0:1788390319.771854:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188480 00000100:00100000:2.0:1788390319.771914:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788390319.771922:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188480:12345-0@lo:502: 00000100:00100000:2.0:1788390319.772194:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188480:12345-0@lo:502: Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.772201:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390319.772250:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188480:0@lo:502: 00000040:00080000:0.0:1788390319.772557:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788390319.772597:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788390319.772623:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788390319.772666:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788390319.772699:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788390319.772727:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788390319.772748:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188608:0@lo:502: 00000100:00100000:0.0:1788390319.772781:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.772913:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390319.773030:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188608 00000100:00100000:2.0:1788390319.773036:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188608 00000100:00100000:2.0:1788390319.773112:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390319.773121:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188608:12345-0@lo:502: 00000100:00100000:2.0:1788390319.773304:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188608:12345-0@lo:502: Request processed in 184us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.773311:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788390319.773451:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188608:0@lo:502: 00000040:00080000:0.0:1788390319.773535:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788390319.773545:0:7583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788390319.774192:0:7590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390319.774200:0:7590:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788390319.774206:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390319.774208:0:7590:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788390319.774213:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390319.774235:0:7590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d6bc75b370) 00000020:00000080:3.0:1788390319.774254:0:7590:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788390319.774260:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390319.774314:0:7590:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6a6b1a000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788390319.774321:0:7590:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390319.774326:0:7590:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd31bcd 00010000:00010000:2.0:1788390319.780712:0:7590:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788390319.781199:0:7590:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788390319.783113:0:7590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788390319.783375:0:7590:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788390319.786523:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788390319.788689:0:7590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788390319.789906:0:7590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788390319.789920:0:7590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390319.789925:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390319.789927:0:7590:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788390319.789930:0:7590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390319.789934:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390319.789935:0:7590:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788390319.789938:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788390319.789940:0:7590:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788390319.790045:0:7590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390319.790048:0:7590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390319.790050:0:7590:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788390319.790053:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788390319.790205:0:7583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788390319.790231:0:7583:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788390319.790250:0:7583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.790263:0:7583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.790271:0:7583:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a6b1a000 from 1 10000000:01000000:1.0:1788390319.790278:0:7583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390319.790311:0:7583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.790319:0:7583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.790330:0:7583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.790412:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188736:0@lo:101: 00000100:00100000:1.0:1788390319.790479:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.790557:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390319.792174:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188736 00000100:00100000:3.0:1788390319.792185:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188736 00000100:00100000:3.0:1788390319.792233:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788390319.792242:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:7583:x1875263103188736:12345-0@lo:101: 00010000:00010000:3.0:1788390319.792255:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390319.792270:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31bd4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.792303:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.792314:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.792323:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788390319.792381:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103188736:12345-0@lo:101: Request processed in 141us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.792388:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788390319.793029:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188736:0@lo:101: 00010000:00010000:1.0:1788390319.793049:0:7583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.793060:0:7583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.793171:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188864:0@lo:501: 00000100:00100000:1.0:1788390319.793211:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.793246:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.794080:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188864 00000100:00100000:0.0:1788390319.794088:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188864 00000100:00100000:0.0:1788390319.794131:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788390319.794140:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103188864:12345-0@lo:501: 00000100:00100000:0.0:1788390319.795483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103188864:12345-0@lo:501: Request processed in 1336us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.795494:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788390319.795621:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188864:0@lo:501: 00000100:00100000:1.0:1788390319.795670:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188992:0@lo:503: 00000100:00100000:1.0:1788390319.795714:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.795760:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.796281:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103188992 00000100:00100000:0.0:1788390319.796288:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103188992 00000100:00100000:0.0:1788390319.796323:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390319.796331:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103188992:12345-0@lo:503: 00000100:00100000:0.0:1788390319.796709:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103188992:12345-0@lo:503: Request processed in 379us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.796723:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390319.796989:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103188992:0@lo:503: 00000040:00080000:1.0:1788390319.797272:0:7583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390319.797519:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189120:0@lo:502: 00000100:00100000:1.0:1788390319.797573:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.798116:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.800685:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189120 00000100:00100000:0.0:1788390319.800697:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189120 00000100:00100000:0.0:1788390319.800781:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788390319.800791:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103189120:12345-0@lo:502: 00000100:00100000:0.0:1788390319.801079:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103189120:12345-0@lo:502: Request processed in 289us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.801087:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390319.801187:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189120:0@lo:502: 00000040:00080000:2.0:1788390319.801468:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788390319.801519:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788390319.801553:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189248:0@lo:502: 00000100:00100000:2.0:1788390319.801594:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.801805:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390319.801863:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189248 00000100:00100000:1.0:1788390319.801868:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189248 00000100:00100000:1.0:1788390319.801892:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788390319.801899:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103189248:12345-0@lo:502: 00000100:00100000:1.0:1788390319.802100:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103189248:12345-0@lo:502: Request processed in 201us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.802108:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788390319.802167:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189248:0@lo:502: 00000040:00080000:2.0:1788390319.802243:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788390319.802252:0:7583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788390319.802790:0:7594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390319.802799:0:7594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390319.802802:0:7594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788390319.802808:0:7594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6a6b1a000 00000020:00000080:2.0:1788390319.802810:0:7594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390319.802828:0:7594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390319.802831:0:7594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390319.802833:0:7594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788390319.802836:0:7594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788390319.802935:0:7583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788390319.802951:0:7583:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390319.802990:0:7583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.803001:0:7583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.803037:0:7583:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788390319.803040:0:7583:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6a6b1a000 10000000:01000000:1.0:1788390319.803042:0:7583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6a6b1a000 10000000:01000000:1.0:1788390319.803046:0:7583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390319.803051:0:7583:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a6b1a000 from 1 10000000:01000000:1.0:1788390319.803053:0:7583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390319.803079:0:7583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.803087:0:7583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.803103:0:7583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.803119:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189376:0@lo:101: 00000100:00100000:1.0:1788390319.803154:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.803181:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.803245:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189376 00000100:00100000:0.0:1788390319.803251:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189376 00000100:00100000:0.0:1788390319.803276:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788390319.803283:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103189376:12345-0@lo:101: 00010000:00010000:0.0:1788390319.803293:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390319.803304:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31be2 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.803322:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.803342:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390319.803351:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031800, rc 0) 00000100:00100000:0.0:1788390319.803379:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189376:12345-0@lo:101: Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.803386:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390319.803518:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189376:0@lo:101: 00010000:00010000:1.0:1788390319.803532:0:7583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.803541:0:7583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.803610:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189504:0@lo:501: 00000100:00100000:1.0:1788390319.803633:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.803652:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.803688:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189504 00000100:00100000:0.0:1788390319.803692:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189504 00000100:00100000:0.0:1788390319.803722:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788390319.803728:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189504:12345-0@lo:501: 00000100:00100000:0.0:1788390319.803920:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189504:12345-0@lo:501: Request processed in 191us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.803926:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390319.804008:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189504:0@lo:501: 00000100:00100000:1.0:1788390319.804028:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189632:0@lo:503: 00000100:00100000:1.0:1788390319.804061:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.804076:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.804208:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189632 00000100:00100000:0.0:1788390319.804212:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189632 00000100:00100000:0.0:1788390319.804238:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390319.804244:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189632:12345-0@lo:503: 00000100:00100000:0.0:1788390319.804462:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189632:12345-0@lo:503: Request processed in 217us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.804581:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788390319.804646:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189632:0@lo:503: 00000040:00080000:1.0:1788390319.804884:0:7583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390319.804943:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189760:0@lo:502: 00000100:00100000:1.0:1788390319.805006:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.805030:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.805134:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189760 00000100:00100000:0.0:1788390319.805138:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189760 00000100:00100000:0.0:1788390319.805172:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788390319.805180:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189760:12345-0@lo:502: 00000100:00100000:2.0:1788390319.805418:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189760:0@lo:502: 00000040:00080000:2.0:1788390319.805661:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788390319.805700:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788390319.805726:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788390319.805761:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788390319.805789:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788390319.805831:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788390319.805864:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788390319.805892:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788390319.805928:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788390319.805955:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788390319.806012:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788390319.806056:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788390319.806090:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788390319.806122:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788390319.806169:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788390319.806214:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788390319.806245:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788390319.806287:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788390319.806316:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000100:00100000:0.0:1788390319.806427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189760:12345-0@lo:502: Request processed in 1245us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.806444:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000040:00080000:2.0:1788390319.806617:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788390319.806675:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788390319.806705:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788390319.806730:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788390319.806776:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788390319.806807:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788390319.806838:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788390319.808592:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788390319.808663:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788390319.808689:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788390319.808727:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788390319.808754:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788390319.808793:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788390319.808833:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788390319.808887:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788390319.808919:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788390319.808957:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788390319.809008:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788390319.809050:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189888:0@lo:502: 00000100:00100000:2.0:1788390319.809116:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.809152:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390319.809228:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103189888 00000100:00100000:0.0:1788390319.809235:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103189888 00000100:00100000:0.0:1788390319.809280:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788390319.809288:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189888:12345-0@lo:502: 00000100:00100000:0.0:1788390319.809514:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103189888:12345-0@lo:502: Request processed in 225us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390319.809522:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390319.809707:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103189888:0@lo:502: 00000040:00080000:3.0:1788390319.809772:0:7583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788390319.809782:0:7583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788390319.810452:0:7595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788390319.810472:0:7595:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d6bc2799b8) 00000020:00000080:0.0:1788390319.810494:0:7595:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788390319.810573:0:7595:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6a6b1a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390319.810577:0:7595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6a6b1a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390319.810580:0:7595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a6b1a000 3 00010000:00080000:0.0:1788390319.810604:0:7595:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d5810a6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1788390319.812791:0:7595:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788390319.813159:0:7595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788390319.813195:0:7595:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788390319.813205:0:7595:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd31bf7 00000100:00080000:1.0:1788390319.813214:0:7595:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390319.813219:0:7595:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5810a6800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390319.813250:0:7595:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d682f29880 x1875263103190016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390319.813274:0:7595:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788390319.815113:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103190016:0@lo:38: 00000100:00100000:3.0:1788390319.815193:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.815292:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190016 00000100:00100000:0.0:1788390319.815300:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190016 00000100:00100000:3.0:1788390319.816455:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390319.816465:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103190016:12345-0@lo:38: 00010000:00080000:3.0:1788390319.816501:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:3.0:1788390319.816538:0:5807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd31bfe 00000004:00100000:3.0:1788390319.816554:0:5807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788390319.816584:0:5807:0:(import.c:65:import_set_state_nolock()) ffff95d6853bf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390319.816652:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103190016:12345-0@lo:38: Request processed in 186us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.816660:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788390319.816706:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d682f29880 x1875263103190016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390319.816722:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390319.816730:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788390319.816739:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788390319.816743:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788390319.816745:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788390319.816751:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103190016:0@lo:38: 00000100:00100000:2.0:1788390319.818476:0:7596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7596:1875263103190144:0@lo:901: 00000100:00100000:2.0:1788390319.818538:0:7596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.818574:0:7596:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b51389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390319.818626:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190144 00000100:00100000:3.0:1788390319.818633:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190144 00000100:00100000:3.0:1788390319.818682:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390319.818689:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7596:x1875263103190144:12345-0@lo:901: 00000100:00100000:3.0:1788390319.819250:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7596:x1875263103190144:12345-0@lo:901: Request processed in 558us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.819259:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788390319.819376:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788390319.819460:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788390319.819648:0:7583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788390319.819670:0:7583:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390319.819690:0:7583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390319.819701:0:7583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788390319.819739:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788390319.819741:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390319.819743:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390319.819744:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390319.819745:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390319.819747:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390319.819748:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390319.819752:0:7583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788390319.819754:0:7583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788390319.819755:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390319.819756:0:7583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390319.819760:0:7583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788390319.819762:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390319.819763:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390319.819764:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390319.819765:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390319.819766:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390319.819767:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390319.819768:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390319.819769:0:7583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788390319.819770:0:7583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788390319.819771:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390319.819772:0:7583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390319.819797:0:7583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788390319.819808:0:7583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103190272:0@lo:253: 00000100:00100000:3.0:1788390319.819844:0:7583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.819872:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190272 00000100:00100000:3.0:1788390319.819877:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190272 00000100:00100000:3.0:1788390319.819913:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788390319.819921:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:7583:x1875263103190272:12345-0@lo:253: 20000000:01000000:3.0:1788390319.819943:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788390319.819956:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788390319.820351:0:7583:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875dfe40 going to sleep for 11 seconds 00010000:00080000:3.0:1788390319.821491:0:7596:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bcb2ca80 x1875263103190144/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788390335 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390319.821509:0:7596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7596:1875263103190144:0@lo:901: 20000000:01000000:0.0:1788390319.850120:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390319.850139:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788390319.850204:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390319.850209:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390319.850231:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.850248:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.850257:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.850294:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.850307:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390319.850320:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103190400:0@lo:104: 00000100:00100000:2.0:1788390319.850385:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390319.850440:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390319.850877:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190400 00000100:00100000:1.0:1788390319.850886:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190400 00000100:00100000:1.0:1788390319.850938:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390319.850947:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103190400:12345-0@lo:104: 00010000:00010000:1.0:1788390319.850988:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851045:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390319.851051:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:5823:x1875263103190400:12345-0@lo:104: Request processed in 105us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.851057:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788390319.851079:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390319.851085:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851092:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680030600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390319.851096:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851119:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390319.851127:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390319.851134:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390319.851161:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851167:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390319.851183:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851190:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680030600/0x9aafc5f04cd31b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b56 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851208:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390319.851210:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390319.851212:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390319.851228:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103190528:0@lo:103: 00000100:00100000:1.0:1788390319.851264:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.851299:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190528 00000100:00100000:1.0:1788390319.851303:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190528 00010000:00010000:1.0:1788390319.851317:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.851348:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390319.851355:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3286:x1875263103190528:12345-0@lo:103: 00010000:00010000:1.0:1788390319.851369:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390319.851373:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851383:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 15 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851398:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851406:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390319.851417:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003124222s 00010000:00010000:1.0:1788390319.851421:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851437:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851445:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851451:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851457:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdda00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390319.851461:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851468:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851480:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390319.851489:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390319.851516:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3286:x1875263103190528:12345-0@lo:103: Request processed in 162us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.851525:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390319.851578:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103190528:0@lo:103: 00010000:00010000:2.0:1788390319.851644:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b4f expref: 14 pid: 5799 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390319.851654:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875263103190400:0@lo:104: 00010000:00010000:2.0:1788390319.851666:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.851674:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.851680:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390319.851686:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd31c05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390319.858856:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:7583:x1875263103190272:12345-0@lo:253: Request processed in 38925us (39001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.858870:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788390319.860442:0:7583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:7583:1875263103190272:0@lo:253: 10000000:01000000:3.0:1788390319.860464:0:7583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788390319.860467:0:7583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390319.860486:0:7583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390319.860488:0:7583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390319.860489:0:7583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390319.860490:0:7583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390319.860491:0:7583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390319.860492:0:7583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390319.860494:0:7583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788390319.860495:0:7583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788390319.860497:0:7583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390319.860498:0:7583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788390319.860515:0:7583:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390319.864701:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390319.864891:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390319.865112:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390319.865267:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390319.865447:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390319.865668:0:7583:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788390319.866904:0:7583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788390320.120206:0:7583:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788390320.120213:0:7583:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788390320.120249:0:7583:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788390320.120306:0:7583:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788390320.120320:0:7583:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788390320.120402:0:7583:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788390320.590452:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390321.613990:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390322.638073:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390323.661412:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390324.687464:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103190656:0@lo:13: 00000100:00100000:2.0:1788390324.687525:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390324.687582:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390324.687593:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190656 00000100:00100000:2.0:1788390324.687599:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190656 00000100:00100000:2.0:1788390324.687647:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390324.687655:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103190656:12345-0@lo:13: 00002000:00000024:2.0:1788390324.687686:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390324.687721:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103190656:12345-0@lo:13: Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.687735:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788390324.687754:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390324.687778:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bcb2f480 x1875263103190656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390324.687793:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103190656:0@lo:13: 00000100:00100000:0.0:1788390325.197814:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103191040:0@lo:400: 00000100:00100000:0.0:1788390325.197876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390325.197929:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390325.197934:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103191168:0@lo:400: 00000100:00100000:0.0:1788390325.197956:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390325.198097:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103190784:0@lo:400: 00000100:00100000:3.0:1788390325.198129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390325.198156:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103191296:0@lo:400: 00000100:00100000:3.0:1788390325.198176:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390325.198191:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390325.198196:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103190912:0@lo:400: 00000100:00100000:3.0:1788390325.198213:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390325.198237:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191040 00000100:00100000:3.0:1788390325.198243:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191040 00000100:00100000:3.0:1788390325.198292:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191296 00000100:00100000:3.0:1788390325.198294:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191296 00000100:00100000:3.0:1788390325.198304:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190912 00000100:00100000:3.0:1788390325.198306:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190912 00000100:00100000:3.0:1788390325.198319:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390325.198326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103191040:12345-0@lo:400: 00000100:00100000:3.0:1788390325.198366:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103191040:12345-0@lo:400: Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390325.198372:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390325.198400:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390325.198406:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103191296:12345-0@lo:400: 00000100:00100000:3.0:1788390325.198437:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103191296:12345-0@lo:400: Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390325.198442:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390325.198453:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390325.198458:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103190912:12345-0@lo:400: 00000100:00100000:3.0:1788390325.198479:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103190912:12345-0@lo:400: Request processed in 22us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390325.198484:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788390325.198547:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691831880 x1875263103191040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390325.198560:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103191040:0@lo:400: 00000100:00080000:0.0:1788390325.199632:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390325.201579:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103190784 00000100:00100000:2.0:1788390325.201594:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103190784 00000100:00100000:2.0:1788390325.201651:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788390325.201662:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103190784:12345-0@lo:400: 00000100:00100000:2.0:1788390325.201742:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103190784:12345-0@lo:400: Request processed in 82us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390325.201749:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788390325.205409:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191168 00000100:00100000:3.0:1788390325.205423:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191168 00010000:00080000:3.0:1788390325.205511:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691833480 x1875263103190912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390325.205526:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103190912:0@lo:400: 00000100:00100000:3.0:1788390325.205538:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103190784:0@lo:400: 00010000:00080000:3.0:1788390325.205549:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691831180 x1875263103191296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390325.205581:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103191296:0@lo:400: 00000100:00100000:3.0:1788390325.205662:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390325.205672:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103191168:12345-0@lo:400: 00000100:00100000:3.0:1788390325.205749:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103191168:12345-0@lo:400: Request processed in 79us (7792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390325.205756:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788390325.205786:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691831c00 x1875263103191168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390325.205796:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103191168:0@lo:400: 00010000:00010000:1.0:1788390325.715741:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390325.811291:0:7938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788390326.734464:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390327.758651:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390327.758695:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390327.758700:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d69fc01000 from 30 10000000:01000000:0.0:1788390327.758704:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390327.758754:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.758766:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.758798:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.758820:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191424:0@lo:101: 00000100:00100000:0.0:1788390327.758885:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.758934:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e66540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.759245:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191424 00000100:00100000:1.0:1788390327.759254:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191424 00000100:00100000:1.0:1788390327.759315:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390327.759324:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103191424:12345-0@lo:101: 00010000:00010000:1.0:1788390327.759337:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390327.759349:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c0c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.759382:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.759392:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.759413:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813dec00, rc 0) 00000100:00100000:1.0:1788390327.759454:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103191424:12345-0@lo:101: Request processed in 131us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.759461:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390327.759505:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191424:0@lo:101: 00010000:00010000:1.0:1788390327.759520:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.759529:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.759595:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191552:0@lo:501: 00000100:00100000:1.0:1788390327.759621:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.759641:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.759846:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191552 00000100:00100000:2.0:1788390327.759851:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191552 00000100:00100000:2.0:1788390327.759883:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788390327.759892:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103191552:12345-0@lo:501: 00000100:00100000:2.0:1788390327.760163:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103191552:12345-0@lo:501: Request processed in 272us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.760171:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788390327.760206:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191552:0@lo:501: 00000100:00100000:2.0:1788390327.760234:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191680:0@lo:503: 00000100:00100000:2.0:1788390327.760283:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.760296:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861ccd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.760308:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191680 00000100:00100000:2.0:1788390327.760317:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191680 00000100:00100000:2.0:1788390327.760334:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788390327.760340:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103191680:12345-0@lo:503: 00000100:00100000:2.0:1788390327.760486:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103191680:12345-0@lo:503: Request processed in 145us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.760494:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788390327.760529:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103191680:0@lo:503: 00000100:00100000:2.0:1788390327.761118:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8015:1875263103191808:0@lo:502: 00000100:00100000:2.0:1788390327.761153:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.761175:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191808 00000100:00100000:2.0:1788390327.761179:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191808 00000100:00100000:2.0:1788390327.761199:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390327.761205:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8015:x1875263103191808:12345-0@lo:502: 00000100:00100000:2.0:1788390327.761388:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8015:x1875263103191808:12345-0@lo:502: Request processed in 183us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.761396:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390327.761427:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.761440:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8015:1875263103191808:0@lo:502: 00000100:00100000:2.0:1788390327.761479:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8015:1875263103191936:0@lo:502: 00000100:00100000:2.0:1788390327.761510:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.761530:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103191936 00000100:00100000:2.0:1788390327.761533:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103191936 00000100:00100000:2.0:1788390327.762723:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788390327.763061:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.763354:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8015:x1875263103191936:12345-0@lo:502: 00000100:00100000:3.0:1788390327.764062:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8015:1875263103191936:0@lo:502: 00000100:00100000:2.0:1788390327.764128:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8015:x1875263103191936:12345-0@lo:502: Request processed in 1227us (2448us total) trans 0 rc 0/0 00000040:00080000:3.0:1788390327.764152:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:2.0:1788390327.764154:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000020:01000000:2.0:1788390327.764628:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788390327.764656:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390327.764668:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.764679:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390327.764689:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788390327.764692:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788390327.764695:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788390327.764725:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.764745:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.764756:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390327.764776:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192064:0@lo:101: 00000100:00100000:2.0:1788390327.764814:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.764852:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.764952:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192064 00000100:00100000:1.0:1788390327.765043:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192064 00000100:00100000:1.0:1788390327.765085:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788390327.765094:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103192064:12345-0@lo:101: 00010000:00010000:1.0:1788390327.765105:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390327.765118:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c1a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.765141:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.765151:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.765172:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813df600, rc 0) 00000100:00100000:1.0:1788390327.765213:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103192064:12345-0@lo:101: Request processed in 121us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.765219:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788390327.766572:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192064:0@lo:101: 00010000:00010000:3.0:1788390327.766605:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.766619:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.766722:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192192:0@lo:501: 00000100:00100000:3.0:1788390327.766789:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.766845:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192192 00000100:00100000:3.0:1788390327.766847:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.766871:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192192 00000100:00100000:2.0:1788390327.766927:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390327.766937:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103192192:12345-0@lo:501: 00000100:00100000:2.0:1788390327.767258:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103192192:12345-0@lo:501: Request processed in 322us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.767496:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192192:0@lo:501: 00000100:00100000:3.0:1788390327.767555:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192320:0@lo:503: 00000100:00100000:3.0:1788390327.767609:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.767633:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.767759:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192320 00000100:00100000:1.0:1788390327.767764:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192320 00000100:00100000:1.0:1788390327.767788:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788390327.767794:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192320:12345-0@lo:503: 00000100:00100000:1.0:1788390327.768036:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192320:12345-0@lo:503: Request processed in 241us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.768044:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788390327.768197:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192320:0@lo:503: 00000100:00100000:3.0:1788390327.768643:0:8016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8016:1875263103192448:0@lo:502: 00000100:00100000:3.0:1788390327.768680:0:8016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.768704:0:8016:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.768797:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192448 00000100:00100000:1.0:1788390327.768802:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192448 00000100:00100000:1.0:1788390327.768824:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788390327.768830:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8016:x1875263103192448:12345-0@lo:502: 00000100:00100000:2.0:1788390327.769377:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788390327.770374:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8016:x1875263103192448:12345-0@lo:502: Request processed in 1539us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.770383:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788390327.773397:0:8016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8016:1875263103192448:0@lo:502: 00000020:01000000:3.0:1788390327.773445:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390327.773455:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390327.773457:0:8016:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390327.773463:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390327.773465:0:8016:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788390327.773498:0:8016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8016:1875263103192576:0@lo:502: 00000100:00100000:3.0:1788390327.774116:0:8016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.774221:0:8016:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.775465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192576 00000100:00100000:2.0:1788390327.775477:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192576 00000100:00100000:2.0:1788390327.775535:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390327.775639:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8016:x1875263103192576:12345-0@lo:502: 00000100:00100000:2.0:1788390327.775926:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8016:x1875263103192576:12345-0@lo:502: Request processed in 383us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.775933:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788390327.776119:0:8016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8016:1875263103192576:0@lo:502: 00000020:01000000:3.0:1788390327.776150:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390327.776157:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390327.776159:0:8016:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788390327.776164:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788390327.778620:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788390327.778660:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788390327.778671:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.778684:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390327.778712:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788390327.778715:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a0d90000 from 30 10000000:01000000:1.0:1788390327.778718:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390327.779509:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.779520:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.779530:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.779564:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192704:0@lo:101: 00000100:00100000:1.0:1788390327.779628:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.779672:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.779996:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192704 00000100:00100000:0.0:1788390327.780004:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192704 00000100:00100000:0.0:1788390327.780052:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788390327.780062:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103192704:12345-0@lo:101: 00010000:00010000:0.0:1788390327.780074:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390327.780086:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c28 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.780110:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.780121:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.780130:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030800, rc 0) 00000100:00100000:0.0:1788390327.780169:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192704:12345-0@lo:101: Request processed in 108us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.780187:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788390327.780939:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192704:0@lo:101: 00010000:00010000:1.0:1788390327.780957:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.781010:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.781072:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192832:0@lo:501: 00000100:00100000:1.0:1788390327.781107:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.781135:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.781150:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192832 00000100:00100000:1.0:1788390327.781155:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192832 00000100:00100000:1.0:1788390327.781180:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788390327.781200:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192832:12345-0@lo:501: 00000100:00100000:1.0:1788390327.781481:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192832:12345-0@lo:501: Request processed in 282us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.781489:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788390327.781532:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192832:0@lo:501: 00000100:00100000:1.0:1788390327.781728:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192960:0@lo:503: 00000100:00100000:1.0:1788390327.781778:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.781794:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.781808:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103192960 00000100:00100000:1.0:1788390327.781812:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103192960 00000100:00100000:1.0:1788390327.781835:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788390327.781842:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192960:12345-0@lo:503: 00000100:00100000:1.0:1788390327.781999:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103192960:12345-0@lo:503: Request processed in 156us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.782006:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788390327.782043:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103192960:0@lo:503: 00000100:00100000:1.0:1788390327.782307:0:8017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8017:1875263103193088:0@lo:502: 00000100:00100000:1.0:1788390327.782339:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.782369:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193088 00000100:00100000:1.0:1788390327.782373:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193088 00000100:00100000:1.0:1788390327.782398:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788390327.782404:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8017:x1875263103193088:12345-0@lo:502: 00000100:00100000:1.0:1788390327.782881:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8017:x1875263103193088:12345-0@lo:502: Request processed in 476us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.782887:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788390327.782930:0:8017:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.782944:0:8017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8017:1875263103193088:0@lo:502: 00000100:00100000:1.0:1788390327.783131:0:8017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8017:1875263103193216:0@lo:502: 00000100:00100000:1.0:1788390327.783164:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.783396:0:8017:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.785795:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193216 00000100:00100000:0.0:1788390327.785806:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193216 00000100:00100000:0.0:1788390327.785866:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788390327.785876:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8017:x1875263103193216:12345-0@lo:502: 00000100:00100000:0.0:1788390327.786210:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8017:x1875263103193216:12345-0@lo:502: Request processed in 335us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.786217:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788390327.786583:0:8017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8017:1875263103193216:0@lo:502: 00000040:00080000:1.0:1788390327.786616:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788390327.786678:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788390327.786700:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390327.786709:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.786720:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390327.786729:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390327.786743:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d6a0d90000 from 5 10000000:01000000:1.0:1788390327.786746:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390327.786774:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.786787:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.786795:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.786811:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193344:0@lo:101: 00000100:00100000:1.0:1788390327.786845:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.786878:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.786892:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193344 00000100:00100000:1.0:1788390327.786896:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193344 00000100:00100000:1.0:1788390327.786934:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390327.786943:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103193344:12345-0@lo:101: 00010000:00010000:1.0:1788390327.786953:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390327.786985:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c36 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787007:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c36 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787017:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c36 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787025:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813de400, rc 0) 00000100:00100000:1.0:1788390327.787056:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103193344:12345-0@lo:101: Request processed in 114us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.787062:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390327.787092:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193344:0@lo:101: 00010000:00010000:1.0:1788390327.787103:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787112:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.787150:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193472:0@lo:256: 00000100:00100000:1.0:1788390327.787177:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.787190:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.787206:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193472 00000100:00100000:1.0:1788390327.787210:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193472 00000100:00100000:1.0:1788390327.787227:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390327.787231:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103193472:12345-0@lo:256: 20000000:01000000:1.0:1788390327.787243:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390327.787258:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390327.787261:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788390327.787331:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103193472:12345-0@lo:256: Request processed in 98us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.787337:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390327.787378:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193472:0@lo:256: 10000000:01000000:1.0:1788390327.787414:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788390327.787419:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787426:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390327.787432:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788390327.787433:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788390327.787436:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390327.787449:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787455:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787462:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.787482:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193600:0@lo:101: 00000100:00100000:1.0:1788390327.787505:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.787518:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.787740:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193600 00000100:00100000:1.0:1788390327.787744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193600 00000100:00100000:1.0:1788390327.787762:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390327.787768:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103193600:12345-0@lo:101: 00010000:00010000:1.0:1788390327.787774:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390327.787782:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c44 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787795:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787802:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787808:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813dfc00, rc 0) 00000100:00100000:1.0:1788390327.787836:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103193600:12345-0@lo:101: Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.787842:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390327.787869:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193600:0@lo:101: 00010000:00010000:1.0:1788390327.787879:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.787887:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.787937:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193728:0@lo:501: 00000100:00100000:1.0:1788390327.787980:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.787993:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.788004:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193728 00000100:00100000:1.0:1788390327.788007:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193728 00000100:00100000:1.0:1788390327.788023:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788390327.788029:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103193728:12345-0@lo:501: 00000100:00100000:1.0:1788390327.788252:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103193728:12345-0@lo:501: Request processed in 222us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.788259:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788390327.788286:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193728:0@lo:501: 00000100:00100000:1.0:1788390327.788310:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193856:0@lo:503: 00000100:00100000:1.0:1788390327.788345:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.788371:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.788383:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193856 00000100:00100000:1.0:1788390327.788387:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193856 00000100:00100000:1.0:1788390327.788403:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788390327.788408:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103193856:12345-0@lo:503: 00000100:00100000:1.0:1788390327.788592:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103193856:12345-0@lo:503: Request processed in 182us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.788598:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788390327.788634:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103193856:0@lo:503: 00000100:00100000:2.0:1788390327.798294:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8018:1875263103193984:0@lo:502: 00000100:00100000:2.0:1788390327.798383:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.798424:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.799486:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103193984 00000100:00100000:1.0:1788390327.799511:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103193984 00000100:00100000:1.0:1788390327.799584:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788390327.799594:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8018:x1875263103193984:12345-0@lo:502: 00000100:00100000:1.0:1788390327.800018:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8018:x1875263103193984:12345-0@lo:502: Request processed in 424us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.800026:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390327.800414:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8018:1875263103193984:0@lo:502: 00000020:01000000:3.0:1788390327.800459:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390327.800466:0:8018:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788390327.800473:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390327.800475:0:8018:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788390327.800481:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390327.800485:0:8018:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1788390327.800514:0:8018:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788390327.800517:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390327.800532:0:8018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95d6bc75cd28) 00000020:00000080:3.0:1788390327.800564:0:8018:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788390327.800571:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390327.800645:0:8018:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788390327.800650:0:8018:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788390327.800658:0:8018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd31c59 00010000:00080000:3.0:1788390327.800684:0:8018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d69fc07800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390327.800930:0:8018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788390327.801339:0:8018:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788390327.801353:0:8018:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788390327.802682:0:8018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390327.803378:0:8018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390327.803437:0:8018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788390327.803500:0:8018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788390327.809694:0:8020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390327.809703:0:8020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788390327.810373:0:8018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390327.810386:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788390327.810422:0:8018:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788390327.810447:0:8018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd31c60 00000100:00080000:0.0:1788390327.810458:0:8018:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390327.810463:0:8018:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d69fc07800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390327.810502:0:8018:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d691831500 x1875263103194112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390327.810672:0:8018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788390327.810730:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390327.810734:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.810736:0:8018:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788390327.810739:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390327.810742:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.810744:0:8018:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390327.810747:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390327.810748:0:8018:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788390327.810776:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8018:1875263103194240:0@lo:502: 00000100:00100000:0.0:1788390327.811334:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.811388:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194240 00000100:00100000:0.0:1788390327.811395:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194240 00000100:00100000:0.0:1788390327.811435:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390327.811444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8018:x1875263103194240:12345-0@lo:502: 00000100:00100000:1.0:1788390327.811631:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103194112:0@lo:8: 00000100:00100000:1.0:1788390327.811710:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.811760:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194112 00000100:00100000:1.0:1788390327.811764:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194112 00000100:00100000:1.0:1788390327.811786:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390327.811792:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103194112:12345-0@lo:8: 00010000:00080000:1.0:1788390327.811815:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:1.0:1788390327.811854:0:6650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd31c67 00002000:00100000:1.0:1788390327.811867:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d6bc738800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788390327.811871:0:6650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788390327.811875:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788390327.812072:0:6650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390327.812246:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788390327.812602:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390327.812669:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103194112:12345-0@lo:8: Request processed in 876us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.812682:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788390327.812747:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691831500 x1875263103194112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390327.812758:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390327.812766:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788390327.812776:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788390327.812781:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788390327.812783:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d69fc07800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788390327.812794:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788390327.812800:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103194112:0@lo:8: 00000004:00080000:1.0:1788390327.812835:0:8020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788390327.813141:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8018:x1875263103194240:12345-0@lo:502: Request processed in 1697us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.813241:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390327.813445:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103194368:0@lo:400: 00000100:00100000:0.0:1788390327.813477:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.813503:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1788390327.813648:0:8020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 144920686299ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788390327.813957:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103194752:0@lo:400: 00000100:00100000:0.0:1788390327.814001:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.814027:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103194496:0@lo:400: 00000100:00100000:0.0:1788390327.814048:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.814063:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390327.814067:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103194624:0@lo:400: 00000100:00100000:0.0:1788390327.814088:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.814114:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194368 00000100:00100000:0.0:1788390327.814119:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194368 00000100:00100000:0.0:1788390327.814196:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194752 00000100:00100000:0.0:1788390327.814200:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194752 00000100:00100000:0.0:1788390327.814221:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194496 00000100:00100000:0.0:1788390327.814223:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194496 00000100:00100000:0.0:1788390327.814239:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390327.814247:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103194368:12345-0@lo:400: 00000100:00100000:0.0:1788390327.814748:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103194368:12345-0@lo:400: Request processed in 500us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.814756:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390327.814771:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390327.814777:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103194752:12345-0@lo:400: 00000100:00100000:0.0:1788390327.814801:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103194752:12345-0@lo:400: Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.814815:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390327.814838:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390327.814845:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103194496:12345-0@lo:400: 00000100:00100000:0.0:1788390327.814878:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103194496:12345-0@lo:400: Request processed in 34us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.814884:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390327.814928:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194624 00000100:00100000:0.0:1788390327.814932:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194624 00000100:00100000:0.0:1788390327.815041:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390327.815048:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103194624:12345-0@lo:400: 00000100:00100000:0.0:1788390327.815079:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103194624:12345-0@lo:400: Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.815085:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788390327.815100:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390327.815104:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788390327.815131:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691830700 x1875263103194624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390327.815154:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103194624:0@lo:400: 00010000:00080000:0.0:1788390327.815166:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691832680 x1875263103194496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390327.815175:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103194496:0@lo:400: 00010000:00080000:0.0:1788390327.815216:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691833800 x1875263103194752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390327.815226:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103194752:0@lo:400: 00010000:00080000:0.0:1788390327.815237:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691830e00 x1875263103194368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390327.815252:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103194368:0@lo:400: 00000100:00100000:0.0:1788390327.815293:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.815306:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8018:1875263103194240:0@lo:502: 00000020:01000000:0.0:1788390327.815338:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390327.815344:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.815346:0:8018:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390327.815350:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788390327.826150:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788390327.826192:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788390327.826204:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.826217:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390327.826227:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788390327.826229:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d68a8e99b8 from 1 10000000:01000000:0.0:1788390327.826232:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788390327.826329:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.826337:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.826348:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.826401:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103194880:0@lo:101: 00000100:00100000:0.0:1788390327.826480:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.826735:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.838953:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103194880 00000100:00100000:2.0:1788390327.838978:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103194880 00000100:00100000:2.0:1788390327.839033:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390327.839044:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103194880:12345-0@lo:101: 00010000:00010000:2.0:1788390327.839060:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390327.839075:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31c6e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.839101:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.839112:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.839122:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:2.0:1788390327.839193:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103194880:12345-0@lo:101: Request processed in 150us (12712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.839205:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390327.839260:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103194880:0@lo:101: 00010000:00010000:2.0:1788390327.839278:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.839287:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390327.839352:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103195008:0@lo:501: 00000100:00100000:2.0:1788390327.839400:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.839432:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.839445:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195008 00000100:00100000:2.0:1788390327.839449:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195008 00000100:00100000:2.0:1788390327.839469:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788390327.839475:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103195008:12345-0@lo:501: 00000100:00100000:2.0:1788390327.839719:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103195008:12345-0@lo:501: Request processed in 242us (317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390327.839726:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788390327.839753:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103195008:0@lo:501: 10000000:01000000:2.0:1788390327.839775:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788390327.839781:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.839789:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390327.911309:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788390328.010077:0:8023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788390328.010120:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195264:0@lo:7: 00000100:00100000:1.0:1788390328.010215:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390328.010288:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390328.010317:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390328.010332:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103195136:0@lo:13: 00000100:00100000:1.0:1788390328.010373:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390328.010413:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195264 00000100:00100000:1.0:1788390328.010423:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195264 00000100:00100000:1.0:1788390328.010501:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390328.010513:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8023:x1875263103195264:12345-0@lo:7: 00000100:00100000:0.0:1788390328.011114:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195136 00000100:00100000:0.0:1788390328.011122:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195136 00000100:00100000:0.0:1788390328.011168:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390328.011177:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103195136:12345-0@lo:13: 00002000:00000024:0.0:1788390328.011209:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788390328.011279:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103195136:12345-0@lo:13: Request processed in 103us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390328.011287:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788390328.031129:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f29f80 x1875263103195136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390328.031164:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103195136:0@lo:13: 00000100:00080000:0.0:1788390328.031219:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788390328.033338:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788390328.033348:0:6653:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788390328.033493:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8023:x1875263103195264:12345-0@lo:7: Request processed in 22972us (23269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390328.033517:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788390328.033640:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f29880 x1875263103195264/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390328.033660:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195264:0@lo:7: 00000004:00080000:1.0:1788390328.033679:0:8023:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788390328.033729:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195392:0@lo:5: 00000100:00100000:1.0:1788390328.033767:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390328.035018:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195392 00000100:00100000:0.0:1788390328.035036:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195392 00000100:00100000:0.0:1788390328.035104:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390328.035117:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8023:x1875263103195392:12345-0@lo:5: 00002000:00080000:0.0:1788390328.035158:0:6650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788390328.035163:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788390328.039488:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390328.041055:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8023:x1875263103195392:12345-0@lo:5: Request processed in 5926us (7272us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788390328.041074:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788390328.041526:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f29880 x1875263103195392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390328.041550:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195392:0@lo:5: 00000004:00080000:1.0:1788390328.041569:0:8023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788390328.041628:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195520:0@lo:700: 00000100:00100000:1.0:1788390328.041673:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390328.041719:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390328.041739:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195520 00000100:00100000:1.0:1788390328.041747:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195520 00000100:00100000:1.0:1788390328.041883:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390328.041897:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8023:x1875263103195520:12345-0@lo:700: 00000100:00100000:1.0:1788390328.041944:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6659:1875263103195648:0@lo:700: 00000100:00100000:1.0:1788390328.042022:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390328.042042:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390328.042061:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195648 00000100:00100000:1.0:1788390328.042065:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195648 00000100:00100000:1.0:1788390328.042106:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390328.042113:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6659:x1875263103195648:12345-0@lo:700: 40000000:02000000:2.0:1788390328.183852:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788390328.187254:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6659:x1875263103195648:12345-0@lo:700: Request processed in 145134us (145225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390328.187268:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788390328.188781:0:6659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f2a680 x1875263103195648/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788390344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390328.188805:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6659:1875263103195648:0@lo:700: 40000000:02000000:0.0:1788390328.188832:0:6659:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788390328.326902:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8023:x1875263103195520:12345-0@lo:700: Request processed in 284999us (285220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390328.326916:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788390328.326993:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f29c00 x1875263103195520/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390328.327009:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195520:0@lo:700: 00000001:00080000:2.0:1788390328.327593:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788390328.327610:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788390328.347219:0:8023:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788390328.350633:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195776:0@lo:5: 00000100:00100000:1.0:1788390328.350759:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390328.350820:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390328.350872:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195776 00000100:00100000:2.0:1788390328.350879:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195776 00000100:00100000:2.0:1788390328.351007:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390328.351020:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8023:x1875263103195776:12345-0@lo:5: 00002000:00080000:3.0:1788390328.357329:0:6653:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788390328.357372:0:6653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788390328.364136:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8023:x1875263103195776:12345-0@lo:5: Request processed in 13107us (13365us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788390328.364154:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788390328.364220:0:8023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bcb2d880 x1875263103195776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390328.364238:0:8023:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788390328.364253:0:8023:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d6bcb2d880 x1875263103195776/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390344 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390328.364276:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8023:1875263103195776:0@lo:5: 00000004:00080000:1.0:1788390328.364290:0:8023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788390328.781299:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390329.805215:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390329.805312:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390329.805345:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103195904:0@lo:13: 00000100:00100000:3.0:1788390329.805404:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390329.805547:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103195904 00000100:00100000:2.0:1788390329.805558:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103195904 00000100:00100000:2.0:1788390329.805644:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390329.805655:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103195904:12345-0@lo:13: 00002000:00000024:2.0:1788390329.805689:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390329.805740:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103195904:12345-0@lo:13: Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390329.805747:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788390329.805801:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390329.805857:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bcb2e300 x1875263103195904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390329.805877:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103195904:0@lo:13: 00010000:00010000:2.0:1788390330.829142:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788390331.728539:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788390331.856087:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390332.289166:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390332.289211:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093735552 00000100:00100000:1.0:1788390332.289227:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093735552 00000100:00100000:1.0:1788390332.289263:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:1.0:1788390332.289271:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1875263093735552:12345-192.168.202.1@tcp:250: 00010000:00080000:1.0:1788390332.289297:0:5799:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f8adeaca-b4c6-45fd-8f27-5a9acbbf397a@192.168.202.1@tcp t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:1.0:1788390332.289332:0:5799:0:(genops.c:1385:class_connect()) connect: client f8adeaca-b4c6-45fd-8f27-5a9acbbf397a, cookie 0x9aafc5f04cd31c7c 00000100:00080000:1.0:1788390332.290051:0:5799:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390332.290123:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+5:2355:x1875263093735552:12345-192.168.202.1@tcp:250: Request processed in 851us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390332.290132:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788390332.302744:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390332.302981:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093735680 00000100:00100000:2.0:1788390332.303002:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093735680 00000100:00100000:2.0:1788390332.303050:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:2.0:1788390332.303061:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+5:5577:x1875263093735680:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1788390332.303076:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390332.303094:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe98f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.303122:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.303132:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.303141:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:2.0:1788390332.303193:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+6:5577:x1875263093735680:12345-192.168.202.1@tcp:101: Request processed in 133us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.303200:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:1.0:1788390332.307104:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.307266:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093735808 00000100:00100000:3.0:1788390332.307276:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093735808 00000100:00100000:3.0:1788390332.307335:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390332.307346:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+6:5577:x1875263093735808:12345-192.168.202.1@tcp:501: 00000100:00100000:3.0:1788390332.308161:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+6:5577:x1875263093735808:12345-192.168.202.1@tcp:501: Request processed in 813us (1062us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390332.308181:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390332.313781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390332.314912:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093735936 00000100:00100000:2.0:1788390332.314925:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093735936 00000100:00100000:2.0:1788390332.315003:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788390332.315015:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+6:5577:x1875263093735936:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1788390332.315034:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390332.315053:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe996 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.315095:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.315106:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.315128:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:2.0:1788390332.315179:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+7:5577:x1875263093735936:12345-192.168.202.1@tcp:101: Request processed in 168us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.315186:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1788390332.319377:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390332.319413:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736064 00000100:00100000:1.0:1788390332.319422:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736064 00000100:00100000:1.0:1788390332.319470:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1788390332.319479:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+7:5577:x1875263093736064:12345-192.168.202.1@tcp:501: 00000100:00100000:1.0:1788390332.319896:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5577:x1875263093736064:12345-192.168.202.1@tcp:501: Request processed in 416us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390332.319904:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1788390332.324992:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390332.325134:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736192 00000100:00100000:2.0:1788390332.325142:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736192 00000100:00100000:2.0:1788390332.325186:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1788390332.325196:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5577:x1875263093736192:12345-192.168.202.1@tcp:503: 00000100:00100000:2.0:1788390332.325586:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5577:x1875263093736192:12345-192.168.202.1@tcp:503: Request processed in 390us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.325594:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788390332.352241:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.352381:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736320 00000100:00100000:3.0:1788390332.352394:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736320 00000100:00100000:3.0:1788390332.352455:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390332.352473:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5596:x1875263093736320:12345-192.168.202.1@tcp:502: 00000100:00100000:3.0:1788390332.352809:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5596:x1875263093736320:12345-192.168.202.1@tcp:502: Request processed in 344us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390332.352818:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390332.395858:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.395895:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736448 00000100:00100000:3.0:1788390332.395905:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736448 00000100:00100000:3.0:1788390332.395956:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788390332.395985:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5596:x1875263093736448:12345-192.168.202.1@tcp:502: 00000100:00100000:3.0:1788390332.396274:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5596:x1875263093736448:12345-192.168.202.1@tcp:502: Request processed in 292us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390332.396282:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1788390332.406773:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390332.406845:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736576 00000100:00100000:2.0:1788390332.406855:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736576 00000100:00100000:2.0:1788390332.406909:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1788390332.406919:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5577:x1875263093736576:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1788390332.406936:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390332.406987:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd31c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe9c0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.407018:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd31c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c0 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.407029:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd31c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c0 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390332.407038:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:2.0:1788390332.407114:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5577:x1875263093736576:12345-192.168.202.1@tcp:101: Request processed in 196us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.407122:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788390332.418004:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390332.418103:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736704 00000100:00100000:0.0:1788390332.418115:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736704 00000100:00100000:0.0:1788390332.418165:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788390332.418185:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5577:x1875263093736704:12345-192.168.202.1@tcp:256: 20000000:01000000:0.0:1788390332.418212:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788390332.418236:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788390332.418240:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788390332.418244:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788390332.418246:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788390332.423093:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5577:x1875263093736704:12345-192.168.202.1@tcp:256: Request processed in 4889us (5120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.423109:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788390332.426413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.426546:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736832 00000100:00100000:3.0:1788390332.426555:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736832 00000100:00100000:3.0:1788390332.426609:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1788390332.426620:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5577:x1875263093736832:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1788390332.426636:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390332.426653:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe9c7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390332.426695:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390332.426706:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390332.426717:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390332.426778:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5577:x1875263093736832:12345-192.168.202.1@tcp:101: Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390332.426785:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1788390332.428816:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390332.428909:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093736960 00000100:00100000:0.0:1788390332.428918:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093736960 00000100:00100000:0.0:1788390332.429000:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390332.429010:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5577:x1875263093736960:12345-192.168.202.1@tcp:501: 00000100:00100000:0.0:1788390332.429336:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5577:x1875263093736960:12345-192.168.202.1@tcp:501: Request processed in 326us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.429345:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390332.433891:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390332.434012:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737088 00000100:00100000:2.0:1788390332.434023:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737088 00000100:00100000:2.0:1788390332.434071:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1788390332.434080:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5577:x1875263093737088:12345-192.168.202.1@tcp:503: 00000100:00100000:2.0:1788390332.434506:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5577:x1875263093737088:12345-192.168.202.1@tcp:503: Request processed in 426us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.434516:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:1.0:1788390332.438278:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.439028:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737216 00000100:00100000:3.0:1788390332.439040:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737216 00000100:00100000:3.0:1788390332.439103:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788390332.439113:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5598:x1875263093737216:12345-192.168.202.1@tcp:502: 00000100:00100000:3.0:1788390332.439437:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5598:x1875263093737216:12345-192.168.202.1@tcp:502: Request processed in 324us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390332.439445:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788390332.446935:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390332.447342:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737344 00000100:00100000:0.0:1788390332.447353:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737344 00000100:00100000:0.0:1788390332.447422:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1788390332.447433:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5598:x1875263093737344:12345-192.168.202.1@tcp:502: 00000100:00100000:0.0:1788390332.447675:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5598:x1875263093737344:12345-192.168.202.1@tcp:502: Request processed in 244us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.447689:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1788390332.451712:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390332.452207:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737472 00000100:00100000:3.0:1788390332.452217:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737472 00000100:00100000:3.0:1788390332.452787:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390332.452797:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875263093737472:12345-192.168.202.1@tcp:38: 00010000:00080000:3.0:1788390332.452828:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1788390332.452873:0:5807:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd31c9f 00000004:00100000:3.0:1788390332.452900:0:5807:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788390332.452917:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788390332.489782:0:5807:0:(import.c:65:import_set_state_nolock()) ffff95d5810a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390332.490029:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093737472:12345-192.168.202.1@tcp:38: Request processed in 37230us (38325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.490040:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00010000:00010000:2.0:1788390332.877125:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390332.877174:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103196160:0@lo:400: 00000100:00100000:0.0:1788390332.877185:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103196288:0@lo:400: 00000100:00100000:3.0:1788390332.877265:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103196032:0@lo:400: 00000100:00100000:1.0:1788390332.877265:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103196416:0@lo:400: 00000100:00100000:0.0:1788390332.877350:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390332.877407:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390332.877413:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103196672:0@lo:400: 00000100:00100000:0.0:1788390332.877461:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390332.877500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196288 00000100:00100000:0.0:1788390332.877508:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196288 00000100:00100000:2.0:1788390332.877510:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390332.877553:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196160 00000100:00100000:0.0:1788390332.877556:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196160 00000100:00100000:0.0:1788390332.877572:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390332.877581:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103196288:12345-0@lo:400: 00000100:00100000:2.0:1788390332.877591:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788390332.877600:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788390332.877617:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196672 00000100:00100000:2.0:1788390332.877621:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196672 00000100:00100000:0.0:1788390332.877634:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103196288:12345-0@lo:400: Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.877641:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390332.877648:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390332.877655:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103196672:12345-0@lo:400: 00000100:00100000:0.0:1788390332.877655:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390332.877660:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103196160:12345-0@lo:400: 00000100:00100000:2.0:1788390332.877684:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103196672:12345-0@lo:400: Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.877685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103196160:12345-0@lo:400: Request processed in 26us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390332.877691:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390332.877691:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788390332.877707:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390332.877720:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788390332.877752:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691832680 x1875263103196160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390332.877766:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103196160:0@lo:400: 00010000:00080000:0.0:1788390332.877796:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691833480 x1875263103196672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390332.877803:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788390332.877812:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103196672:0@lo:400: 00010000:00080000:0.0:1788390332.877821:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691830700 x1875263103196288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390332.877828:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103196288:0@lo:400: 00000100:00100000:1.0:1788390332.877988:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390332.878084:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196416 00000100:00100000:0.0:1788390332.878088:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196416 00000100:00100000:0.0:1788390332.878132:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390332.878139:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103196416:12345-0@lo:400: 00000100:00100000:0.0:1788390332.878190:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103196416:12345-0@lo:400: Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.878197:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788390332.878239:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691831180 x1875263103196416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390332.878247:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103196416:0@lo:400: 00000100:00080000:1.0:1788390332.880050:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390332.885085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390332.885138:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196032 00000100:00100000:2.0:1788390332.885139:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103196544:0@lo:400: 00000100:00100000:0.0:1788390332.885146:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196032 00000100:00100000:2.0:1788390332.885171:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390332.885356:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196544 00000100:00100000:1.0:1788390332.885361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196544 00000100:00080000:2.0:1788390332.885478:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390332.885479:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390332.885491:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103196544:12345-0@lo:400: 00000100:00100000:1.0:1788390332.885549:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103196544:12345-0@lo:400: Request processed in 61us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390332.885555:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390332.885616:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788390332.885624:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103196032:12345-0@lo:400: 00010000:00080000:2.0:1788390332.885674:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691833b80 x1875263103196544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390332.885681:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103196032:12345-0@lo:400: Request processed in 59us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390332.885688:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788390332.885695:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103196544:0@lo:400: 00000100:00100000:2.0:1788390332.885716:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103196032:0@lo:400: 00000100:00100000:2.0:1788390333.389455:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390333.389480:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103196800:0@lo:13: 00000100:00100000:2.0:1788390333.389549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390333.389683:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196800 00000100:00100000:3.0:1788390333.389694:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196800 00000100:00100000:3.0:1788390333.389760:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390333.389772:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103196800:12345-0@lo:13: 00002000:00000024:3.0:1788390333.389810:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390333.389873:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103196800:12345-0@lo:13: Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390333.389881:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788390333.390200:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682f2a680 x1875263103196800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390333.390318:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103196800:0@lo:13: 00000100:00100000:3.0:1788390333.499325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390333.499810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737728 00000100:00100000:0.0:1788390333.499820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737728 00000100:00100000:0.0:1788390333.499905:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390333.499917:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093737728:12345-192.168.202.1@tcp:41: 00000004:00000024:0.0:1788390333.500003:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788390333.500074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093737728:12345-192.168.202.1@tcp:41: Request processed in 159us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.500081:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00080000:2.0:1788390333.500438:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390333.505800:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390333.505890:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737600 00000100:00100000:3.0:1788390333.505900:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737600 00000100:00100000:3.0:1788390333.505981:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390333.505993:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:0:x1875263093737600:12345-192.168.202.1@tcp:41: 00000004:00000024:3.0:1788390333.506023:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788390333.506097:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:0:x1875263093737600:12345-192.168.202.1@tcp:41: Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390333.506104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390333.506892:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390333.506991:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737856 00000100:00100000:2.0:1788390333.506997:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737856 00000100:00100000:2.0:1788390333.507039:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788390333.507049:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093737856:12345-192.168.202.1@tcp:40: 00000100:00100000:2.0:1788390333.507106:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093737856:12345-192.168.202.1@tcp:40: Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390333.507113:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390333.513133:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390333.513248:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093737984 00000100:00100000:2.0:1788390333.513258:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093737984 00000100:00100000:2.0:1788390333.513321:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788390333.513331:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093737984:12345-192.168.202.1@tcp:8: 00010000:00080000:2.0:1788390333.513361:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:2.0:1788390333.513392:0:6650:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd31ca6 00002000:00100000:2.0:1788390333.513405:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1107d28-9e62-443d-a57b-8cc59c78a09a/ffff95d6bbf7f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390333.513428:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788390333.513742:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788390333.513773:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf7d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390333.513847:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093737984:12345-192.168.202.1@tcp:8: Request processed in 515us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390333.513866:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788390333.519732:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390333.519818:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738240 00000100:00100000:3.0:1788390333.519829:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738240 00000100:00100000:3.0:1788390333.519902:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1788390333.519914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093738240:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1788390333.520032:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093738240:12345-192.168.202.1@tcp:400: Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390333.520041:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1788390333.532529:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390333.532577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390333.532777:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738368 00000100:00100000:1.0:1788390333.532787:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738368 00000100:00100000:1.0:1788390333.532845:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390333.532858:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093738368:12345-192.168.202.1@tcp:33: 00000100:00100000:0.0:1788390333.533100:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738112 00000100:00100000:0.0:1788390333.533106:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738112 00000100:00100000:0.0:1788390333.533161:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390333.533167:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263093738112:12345-192.168.202.1@tcp:8: 00010000:00080000:0.0:1788390333.533192:0:6652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:0.0:1788390333.533232:0:6652:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd31cad 00002000:00100000:0.0:1788390333.533244:0:6652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1107d28-9e62-443d-a57b-8cc59c78a09a/ffff95d5810a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390333.533254:0:6652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390333.533655:0:6652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390333.533685:0:6652:0:(import.c:65:import_set_state_nolock()) ffff95d5810a7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390333.533770:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093738112:12345-192.168.202.1@tcp:8: Request processed in 601us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.533787:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000004:00080000:3.0:1788390333.563589:0:5809:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30629us 00000004:00200000:0.0:1788390333.574401:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788390333.574528:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5577:x1875263093738368:12345-192.168.202.1@tcp:33: Request processed in 41667us (41943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.574544:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390333.853536:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390333.853716:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738496 00000100:00100000:0.0:1788390333.853727:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738496 00000100:00100000:0.0:1788390333.853789:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390333.853800:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5615:x1875263093738496:12345-192.168.202.1@tcp:101: 00010000:00010000:0.0:1788390333.853821:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390333.853884:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d680031200/0x9aafc5f04cd31cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe9f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.853949:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.853989:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.854005:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390333.854038:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390333.854042:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390333.854057:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.854077:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d680031200/0x9aafc5f04cd31cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f1 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.854106:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f1 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390333.854111:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23400) 00010000:00010000:0.0:1788390333.854114:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390333.854116:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030600, rc 0) 00000100:00100000:0.0:1788390333.854166:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:5615:x1875263093738496:12345-192.168.202.1@tcp:101: Request processed in 369us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.854173:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:2.0:1788390333.901320:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788390333.951949:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00010000:00010000:2.0:1788390334.927639:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390334.927702:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390334.927742:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103196928:0@lo:13: 00000100:00100000:3.0:1788390334.927835:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.929734:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103196928 00000100:00100000:2.0:1788390334.929757:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103196928 00000100:00100000:2.0:1788390334.929898:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390334.929914:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103196928:12345-0@lo:13: 00002000:00000024:2.0:1788390334.930009:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390334.930144:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103196928:12345-0@lo:13: Request processed in 234us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.930154:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788390334.931370:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788390334.931487:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bcb2c380 x1875263103196928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390334.931515:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103196928:0@lo:13: 00010000:00010000:2.0:1788390335.949130:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390336.102997:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390336.103079:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738624 00000100:00100000:2.0:1788390336.103089:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738624 00000100:00080000:1.0:1788390336.103137:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390336.103158:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788390336.103169:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:5667:x1875263093738624:12345-192.168.202.1@tcp:41: 00000004:00000024:2.0:1788390336.103210:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788390336.103304:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:5667:x1875263093738624:12345-192.168.202.1@tcp:41: Request processed in 137us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390336.103309:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788390336.109549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390336.109694:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738752 00000100:00100000:3.0:1788390336.109719:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738752 00000100:00100000:3.0:1788390336.109812:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390336.109832:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:5667:x1875263093738752:12345-192.168.202.1@tcp:13: 00002000:00000024:3.0:1788390336.109867:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788390336.110051:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390336.110160:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:5667:x1875263093738752:12345-192.168.202.1@tcp:13: Request processed in 337us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390336.110169:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390336.112779:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390336.112888:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093738880 00000100:00100000:2.0:1788390336.112901:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093738880 00000100:00100000:2.0:1788390336.113065:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390336.113078:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5667:x1875263093738880:12345-192.168.202.1@tcp:13: 00002000:00000024:2.0:1788390336.113156:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390336.113243:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:5667:x1875263093738880:12345-192.168.202.1@tcp:13: Request processed in 168us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390336.113251:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00080000:1.0:1788390336.116877:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788390336.987078:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390337.523832:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000001:00100000:0.0:1788390337.558169:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00010000:00010000:2.0:1788390337.997290:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390337.997566:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103197312:0@lo:400: 00000100:00100000:3.0:1788390337.997632:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390337.997691:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390337.997710:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103197184:0@lo:400: 00000100:00100000:3.0:1788390337.997734:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390337.997748:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103197696:0@lo:400: 00000100:00100000:3.0:1788390337.997775:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390337.997808:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197696 00000100:00100000:3.0:1788390337.997814:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197696 00000100:00100000:3.0:1788390337.997875:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390337.997884:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103197696:12345-0@lo:400: 00000100:00100000:3.0:1788390337.997947:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103197696:12345-0@lo:400: Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390337.997954:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788390337.998011:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc741f80 x1875263103197696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390337.998024:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103197696:0@lo:400: 00000100:00100000:1.0:1788390337.998194:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103197440:0@lo:400: 00000100:00100000:1.0:1788390337.998223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390337.998249:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788390337.998255:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103197056:0@lo:400: 00000100:00100000:1.0:1788390337.998293:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390337.998311:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103197568:0@lo:400: 00000100:00100000:1.0:1788390337.998329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390337.998351:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197312 00000100:00100000:1.0:1788390337.998355:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197312 00000100:00100000:1.0:1788390337.998379:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197184 00000100:00100000:1.0:1788390337.998381:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197184 00000100:00100000:1.0:1788390337.998391:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197568 00000100:00100000:1.0:1788390337.998394:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197568 00000100:00100000:1.0:1788390337.998406:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390337.998419:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103197312:12345-0@lo:400: 00000100:00100000:1.0:1788390337.998451:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103197312:12345-0@lo:400: Request processed in 33us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390337.998457:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390337.998472:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390337.998478:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103197184:12345-0@lo:400: 00000100:00100000:1.0:1788390337.998503:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103197184:12345-0@lo:400: Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390337.998509:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390337.998520:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390337.998526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103197568:12345-0@lo:400: 00000100:00100000:1.0:1788390337.998556:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103197568:12345-0@lo:400: Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390337.998561:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788390337.998575:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390337.998578:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390337.998593:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103197568:0@lo:400: 00000100:00100000:3.0:1788390337.998718:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197440 00000100:00100000:3.0:1788390337.998723:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197440 00000100:00100000:3.0:1788390337.998758:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390337.998764:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103197440:12345-0@lo:400: 00000100:00100000:3.0:1788390337.998798:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103197440:12345-0@lo:400: Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390337.998804:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788390337.998832:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc741500 x1875263103197440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390337.998841:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103197440:0@lo:400: 00000100:00100000:3.0:1788390337.998861:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103197184:0@lo:400: 00000100:00100000:3.0:1788390337.998883:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103197312:0@lo:400: 00000100:00080000:1.0:1788390337.999065:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390337.999122:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197056 00000100:00100000:0.0:1788390337.999127:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197056 00000100:00100000:0.0:1788390337.999161:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788390337.999177:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103197056:12345-0@lo:400: 00000100:00100000:0.0:1788390337.999221:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103197056:12345-0@lo:400: Request processed in 54us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390337.999227:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788390337.999359:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103197056:0@lo:400: 00000100:00100000:2.0:1788390338.509123:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390338.509148:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103197824:0@lo:13: 00000100:00100000:2.0:1788390338.509224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390338.509501:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197824 00000100:00100000:0.0:1788390338.509510:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197824 00000100:00100000:0.0:1788390338.509564:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390338.509587:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103197824:12345-0@lo:13: 00002000:00000024:0.0:1788390338.509628:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390338.509684:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103197824:12345-0@lo:13: Request processed in 99us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390338.509691:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788390338.509797:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682e94380 x1875263103197824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390338.509815:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103197824:0@lo:13: 00000100:00100000:2.0:1788390338.689152:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390338.689251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390338.689281:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739008 00000100:00100000:0.0:1788390338.689290:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739008 00000100:00100000:2.0:1788390338.689318:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390338.689339:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:2.0:1788390338.689344:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390338.689348:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093739008:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1788390338.689593:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093739008:12345-192.168.202.1@tcp:400: Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390338.689603:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:2.0:1788390338.691349:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739136 00000100:00100000:2.0:1788390338.691358:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739136 00000100:00100000:2.0:1788390338.691414:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390338.691423:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093739136:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1788390338.691508:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739264 00000100:00100000:3.0:1788390338.691513:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739264 00000100:00100000:3.0:1788390338.691542:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739392 00000100:00100000:3.0:1788390338.691545:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739392 00000100:00100000:3.0:1788390338.691563:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390338.691570:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093739264:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1788390338.691621:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093739264:12345-192.168.202.1@tcp:400: Request processed in 51us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390338.691637:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390338.691652:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390338.691658:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093739392:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1788390338.691684:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093739392:12345-192.168.202.1@tcp:400: Request processed in 26us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390338.691779:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093739136:12345-192.168.202.1@tcp:400: Request processed in 357us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390338.691787:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:2.0:1788390338.691811:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390338.691814:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390338.691816:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390338.691880:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000001:02000400:1.0:1788390338.778770:0:8252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788390339.026373:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390340.045236:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390340.045268:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103197952:0@lo:13: 00000100:00100000:0.0:1788390340.045346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390340.045418:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103197952 00000100:00100000:0.0:1788390340.045426:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103197952 00000100:00100000:0.0:1788390340.045493:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390340.045502:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103197952:12345-0@lo:13: 00002000:00000024:0.0:1788390340.045537:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390340.045583:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103197952:12345-0@lo:13: Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390340.045589:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788390340.045612:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788390340.045640:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a827480 x1875263103197952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390340.045675:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103197952:0@lo:13: 00010000:00010000:2.0:1788390340.049540:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390341.069169:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390341.706420:0:8399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe56577210 20000000:00000080:3.0:1788390341.706435:0:8399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d6bc6dc400 uarg=0000000000000000 20000000:01000000:3.0:1788390341.706468:0:8399:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788390341.706470:0:8399:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788390341.706472:0:8399:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788390341.706476:0:8399:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788390341.706480:0:8399:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788390341.706491:0:8399:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788390341.706492:0:8399:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788390341.706630:0:8399:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788390341.706632:0:8399:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788390341.709553:0:8400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788390341.710868:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788390341.710943:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788390341.711003:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788390341.711019:0:8399:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788390341.711022:0:8399:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788390341.712124:0:8401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788390341.712653:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788390341.712698:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788390341.712747:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788390341.712761:0:8399:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788390341.712763:0:8399:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788390341.713677:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788390341.714478:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788390341.714525:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788390341.714545:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788390341.714552:0:8399:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788390341.714554:0:8399:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788390341.715509:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788390341.716358:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788390341.716408:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788390341.716446:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788390341.716462:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788390341.716480:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716497:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716505:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716512:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716519:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716525:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716532:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716539:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716548:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716555:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716572:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716612:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716627:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 9 pid: 5799 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.716642:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198080:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390341.716796:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716805:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 9 pid: 5800 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.716814:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198208:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390341.716844:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.716852:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 18 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.716861:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198336:0@lo:104: 00000100:00100000:3.0:1788390341.716899:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390341.716989:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.717016:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 18 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.717025:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198464:0@lo:104: 00000100:00100000:3.0:1788390341.717051:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390341.718502:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.718513:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 18 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.718522:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc743480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198592:0@lo:104: 00010000:00010000:3.0:1788390341.718570:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.718579:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 18 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.718588:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198720:0@lo:104: 00010000:00010000:3.0:1788390341.718616:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.718625:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 18 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.718634:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198848:0@lo:104: 00010000:00010000:3.0:1788390341.718661:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.718679:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 18 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.718687:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198976:0@lo:104: 00010000:00010000:3.0:1788390341.718708:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.718715:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 18 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.718722:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103199104:0@lo:104: 00000100:00100000:3.0:1788390341.718737:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390341.718875:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788390341.718897:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390341.718926:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390341.718935:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390341.718943:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390341.718952:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.719036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198336 00000100:00100000:2.0:1788390341.719044:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198336 00000100:00100000:2.0:1788390341.719080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198464 00000100:00100000:2.0:1788390341.719093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198464 00000100:00100000:2.0:1788390341.719107:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198592 00000100:00100000:2.0:1788390341.719109:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198592 00000100:00100000:2.0:1788390341.719119:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198720 00000100:00100000:2.0:1788390341.719122:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198720 00000100:00100000:2.0:1788390341.719149:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198848 00000100:00100000:2.0:1788390341.719152:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198848 00000100:00100000:2.0:1788390341.719162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103198976 00000100:00100000:2.0:1788390341.719185:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103198976 00000100:00100000:2.0:1788390341.719198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199104 00000100:00100000:2.0:1788390341.719201:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199104 00000100:00100000:2.0:1788390341.719213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390341.719221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:8399:x1875263103198336:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719242:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719292:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390341.719298:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+9:8399:x1875263103198336:12345-0@lo:104: Request processed in 78us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390341.719323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390341.719330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc732c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+8:8399:x1875263103198464:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719337:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719370:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390341.719376:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc732c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+8:8399:x1875263103198464:12345-0@lo:104: Request processed in 47us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390341.719420:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390341.719427:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:8399:x1875263103198592:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719433:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719459:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788390341.719464:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+7:8399:x1875263103198592:12345-0@lo:104: Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390341.719482:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390341.719488:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:8399:x1875263103198720:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719494:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719519:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788390341.719524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+6:8399:x1875263103198720:12345-0@lo:104: Request processed in 37us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390341.719540:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390341.719546:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:8399:x1875263103198848:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719552:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719577:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788390341.719581:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:8399:x1875263103198848:12345-0@lo:104: Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390341.719604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390341.719609:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:8399:x1875263103198976:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719616:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719640:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788390341.719644:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:8399:x1875263103198976:12345-0@lo:104: Request processed in 36us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719649:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390341.719660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390341.719666:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8399:x1875263103199104:12345-0@lo:104: 00010000:00010000:2.0:1788390341.719673:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719696:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788390341.719701:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8399:x1875263103199104:12345-0@lo:104: Request processed in 36us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.719707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788390341.719723:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788390341.719728:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719734:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680030a00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.719739:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.719755:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.719762:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.719923:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198336:0@lo:104: 00000100:00100000:3.0:1788390341.719932:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198464:0@lo:104: 00000100:00100000:3.0:1788390341.719940:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc743480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198592:0@lo:104: 00000100:00100000:3.0:1788390341.719946:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198720:0@lo:104: 00000100:00100000:3.0:1788390341.719952:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198848:0@lo:104: 00000100:00100000:3.0:1788390341.719958:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198976:0@lo:104: 00000100:00100000:3.0:1788390341.719982:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103199104:0@lo:104: 10000000:01000000:2.0:1788390341.720177:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720212:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720219:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720245:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720253:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680030a00/0x9aafc5f04cd31c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c75 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720265:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788390341.720269:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720274:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813de200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720276:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720282:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720288:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720299:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720312:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720317:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720331:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720337:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813de200/0x9aafc5f04cd31c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720346:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788390341.720349:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720353:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720356:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720361:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720366:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720371:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720382:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720387:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720399:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720405:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813df800/0x9aafc5f04cd31c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720416:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788390341.720418:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720423:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720426:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720433:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720440:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720445:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720458:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720464:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720469:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720474:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c21 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720483:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788390341.720491:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720497:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720500:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720506:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720511:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720515:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720527:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720531:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720535:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720539:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd31c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31c13 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720548:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390341.720551:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720556:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813de000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720559:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720574:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720579:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720584:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720597:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720602:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720606:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720612:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813de000/0x9aafc5f04cd31be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31be9 expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720620:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390341.720623:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720628:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031a00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390341.720631:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720637:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390341.720642:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390341.720651:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390341.720674:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720680:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390341.720684:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720690:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680031a00/0x9aafc5f04cd31bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bbf expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.720702:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390341.720704:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390341.720705:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390341.720712:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390341.720722:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199232:0@lo:103: 00000100:00100000:2.0:1788390341.720755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.720954:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199744:0@lo:103: 00000100:00100000:2.0:1788390341.720998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721018:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390341.721023:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199616:0@lo:103: 00000100:00100000:2.0:1788390341.721041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721067:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199360:0@lo:103: 00000100:00100000:2.0:1788390341.721145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721157:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199872:0@lo:103: 00000100:00100000:2.0:1788390341.721177:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721194:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788390341.721200:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199488:0@lo:103: 00000100:00100000:2.0:1788390341.721220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721228:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103200000:0@lo:103: 00000100:00100000:2.0:1788390341.721265:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390341.721287:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199232 00000100:00100000:2.0:1788390341.721290:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199232 00010000:00010000:2.0:1788390341.721312:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 19 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721326:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199744 00000100:00100000:2.0:1788390341.721328:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199744 00010000:00010000:2.0:1788390341.721337:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 20 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721346:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199616 00000100:00100000:2.0:1788390341.721348:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199616 00010000:00010000:2.0:1788390341.721356:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 21 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721364:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199360 00000100:00100000:2.0:1788390341.721366:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199360 00010000:00010000:2.0:1788390341.721374:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 22 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721382:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199872 00000100:00100000:2.0:1788390341.721384:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199872 00010000:00010000:2.0:1788390341.721392:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 23 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721400:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103199488 00000100:00100000:2.0:1788390341.721402:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103199488 00010000:00010000:2.0:1788390341.721418:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 24 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721427:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200000 00000100:00100000:2.0:1788390341.721429:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200000 00010000:00010000:2.0:1788390341.721436:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 25 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.721446:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390341.721453:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+25:3287:x1875263103199232:12345-0@lo:103: 00010000:00010000:2.0:1788390341.721462:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.721466:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 25 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721476:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 25 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721489:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd31c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31c6e expref: 25 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721501:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.721529:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+24:3287:x1875263103199232:12345-0@lo:103: Request processed in 77us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.721535:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390341.721549:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390341.721554:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+23:3287:x1875263103199744:12345-0@lo:103: 00010000:00010000:2.0:1788390341.721561:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.721566:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 23 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721583:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 23 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721592:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813dec00/0x9aafc5f04cd31c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31c0c expref: 23 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721600:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.721620:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+22:3287:x1875263103199744:12345-0@lo:103: Request processed in 66us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.721625:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390341.721636:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390341.721641:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+21:3287:x1875263103199616:12345-0@lo:103: 00010000:00010000:2.0:1788390341.721648:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.721652:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 21 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721659:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 21 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721668:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813df600/0x9aafc5f04cd31c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31c1a expref: 21 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721676:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.721694:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+20:3287:x1875263103199616:12345-0@lo:103: Request processed in 54us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.721700:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390341.721711:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390341.721717:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103199360:12345-0@lo:103: 00010000:00010000:2.0:1788390341.721730:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.721734:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 19 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721743:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 19 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721752:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813dfc00/0x9aafc5f04cd31c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31c44 expref: 19 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.721760:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390341.722102:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788390341.722192:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3288:x1875263103199360:12345-0@lo:103: Request processed in 475us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.722199:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390341.722213:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390341.722219:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3288:x1875263103199872:12345-0@lo:103: 00010000:00010000:2.0:1788390341.722245:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.722251:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 17 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722259:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 17 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722268:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31be2 expref: 17 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722278:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.722301:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3288:x1875263103199872:12345-0@lo:103: Request processed in 82us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.722314:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390341.722326:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390341.722331:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3288:x1875263103199488:12345-0@lo:103: 00010000:00010000:2.0:1788390341.722338:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.722343:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 15 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722350:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 15 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722359:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31c28 expref: 15 pid: 5799 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722367:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.722388:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103199488:12345-0@lo:103: Request processed in 57us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.722394:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390341.722405:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390341.722411:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:3288:x1875263103200000:12345-0@lo:103: 00010000:00010000:2.0:1788390341.722417:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390341.722421:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 13 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722428:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 13 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722437:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd31bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31bb8 expref: 13 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.722458:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390341.722481:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3288:x1875263103200000:12345-0@lo:103: Request processed in 70us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390341.722487:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390341.722537:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199616:0@lo:103: 00000100:00100000:2.0:1788390341.722546:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199232:0@lo:103: 00000100:00100000:2.0:1788390341.722553:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103199744:0@lo:103: 00000100:00100000:3.0:1788390341.722955:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198080:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390341.723432:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390341.723455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390341.723474:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739520 00000100:00100000:3.0:1788390341.723479:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739520 00010000:00010000:3.0:1788390341.723501:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 10 pid: 5799 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.723531:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739648 00000100:00100000:3.0:1788390341.723534:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739648 00010000:00010000:3.0:1788390341.723550:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 11 pid: 5800 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390341.723562:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390341.723569:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2357:x1875263093739520:12345-192.168.202.1@tcp:103: 00010000:00010000:3.0:1788390341.723579:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390341.723584:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 11 pid: 5799 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723594:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 11 pid: 5799 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723607:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe996 expref: 11 pid: 5799 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723615:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390341.723650:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093739520:12345-192.168.202.1@tcp:103: Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390341.723657:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390341.723672:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390341.723678:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:2357:x1875263093739648:12345-192.168.202.1@tcp:103: 00010000:00010000:3.0:1788390341.723685:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390341.723690:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 9 pid: 5800 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723710:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 9 pid: 5800 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723722:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723729:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723743:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723750:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723756:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723763:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723782:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390341.723786:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723794:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723803:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390341.723822:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390341.723841:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:2357:x1875263093739648:12345-192.168.202.1@tcp:103: Request processed in 163us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390341.723847:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390341.724093:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199360:0@lo:103: 00000100:00100000:1.0:1788390341.724103:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199872:0@lo:103: 00000100:00100000:1.0:1788390341.724120:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103199488:0@lo:103: 00000100:00100000:1.0:1788390341.724145:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103200000:0@lo:103: 00010000:00010000:2.0:1788390341.724405:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd31c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe98f expref: 8 pid: 5800 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390341.724416:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8399:1875263103198208:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390341.724447:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.724456:0:8399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.724462:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390341.724467:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd31cc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390342.093096:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390343.117939:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103200128:0@lo:400: 00000100:00100000:2.0:1788390343.117955:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103200512:0@lo:400: 00000100:00100000:2.0:1788390343.118026:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.118301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.118346:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103200640:0@lo:400: 00000100:00100000:3.0:1788390343.118382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.118407:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390343.118413:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103200256:0@lo:400: 00000100:00100000:3.0:1788390343.118431:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.118446:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103200768:0@lo:400: 00000100:00100000:3.0:1788390343.118475:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200128 00000100:00100000:3.0:1788390343.118482:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200128 00000100:00100000:3.0:1788390343.118523:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788390343.118531:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3286:x1875263103200128:12345-0@lo:400: 00000100:00100000:0.0:1788390343.118680:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200640 00000100:00100000:0.0:1788390343.118685:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200640 00000100:00100000:0.0:1788390343.118722:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200256 00000100:00100000:0.0:1788390343.118725:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200256 00000100:00100000:0.0:1788390343.118745:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390343.118752:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103200640:12345-0@lo:400: 00000100:00100000:0.0:1788390343.118796:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103200640:12345-0@lo:400: Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.118802:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390343.118817:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390343.118823:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103200256:12345-0@lo:400: 00000100:00100000:0.0:1788390343.118865:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103200256:12345-0@lo:400: Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.118871:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390343.118888:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200512 00000100:00100000:0.0:1788390343.118891:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200512 00000100:00100000:3.0:1788390343.119299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:3286:x1875263103200128:12345-0@lo:400: Request processed in 767us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.119307:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:3.0:1788390343.119368:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390343.119445:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390343.119453:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103200512:12345-0@lo:400: 00000100:00100000:0.0:1788390343.119491:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103200512:12345-0@lo:400: Request processed in 39us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.119497:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788390343.119513:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390343.119517:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390343.119606:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103200384:0@lo:400: 00000100:00100000:1.0:1788390343.119645:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390343.119909:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200384 00000100:00100000:0.0:1788390343.119914:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200384 00000100:00080000:1.0:1788390343.120349:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390343.120419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390343.120430:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103200384:12345-0@lo:400: 00000100:00100000:0.0:1788390343.120469:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103200384:12345-0@lo:400: Request processed in 43us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390343.120814:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103200384:0@lo:400: 00000100:00100000:0.0:1788390343.122436:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390343.127085:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788390343.127098:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cd180 x1875263103200512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390343.127125:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103200512:0@lo:400: 00000100:00100000:3.0:1788390343.127126:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103200128:0@lo:400: 00000100:00100000:3.0:1788390343.127167:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103200640:0@lo:400: 00000100:00100000:3.0:1788390343.127191:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103200256:0@lo:400: 00000100:00100000:0.0:1788390343.127475:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200768 00000100:00100000:0.0:1788390343.127483:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200768 00000100:00100000:0.0:1788390343.127609:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390343.127619:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103200768:12345-0@lo:400: 00000100:00100000:0.0:1788390343.127704:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103200768:12345-0@lo:400: Request processed in 86us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.127711:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788390343.127822:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cc700 x1875263103200768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390343.127843:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103200768:0@lo:400: 00000100:00080000:1.0:1788390343.128145:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1788390343.245589:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788390343.245597:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a6b1a000 from 39 10000000:01000000:1.0:1788390343.245603:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390343.245657:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.245669:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.245680:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.245703:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103200896:0@lo:101: 00000100:00100000:1.0:1788390343.245786:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.245862:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.248509:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103200896 00000100:00100000:0.0:1788390343.248524:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103200896 00000100:00100000:0.0:1788390343.248599:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788390343.248609:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+12:5803:x1875263103200896:12345-0@lo:101: 00010000:00010000:0.0:1788390343.248625:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390343.248644:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031400/0x9aafc5f04cd31cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31cc9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.248669:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031400/0x9aafc5f04cd31cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cc9 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.248680:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031400/0x9aafc5f04cd31cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cc9 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.248690:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031400, rc 0) 00000100:00100000:0.0:1788390343.248771:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103200896:12345-0@lo:101: Request processed in 163us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.248778:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788390343.252841:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103200896:0@lo:101: 00010000:00010000:1.0:1788390343.252878:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.252891:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.253017:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201024:0@lo:501: 00000100:00100000:1.0:1788390343.253069:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.253109:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.253153:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201024 00000100:00100000:3.0:1788390343.253161:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201024 00000100:00100000:3.0:1788390343.253215:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788390343.253234:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103201024:12345-0@lo:501: 00000100:00100000:3.0:1788390343.253497:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103201024:12345-0@lo:501: Request processed in 264us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.253505:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788390343.253575:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201024:0@lo:501: 00000100:00100000:1.0:1788390343.253606:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201152:0@lo:503: 00000100:00100000:1.0:1788390343.253655:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.253674:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.253695:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201152 00000100:00100000:0.0:1788390343.253700:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201152 00000100:00100000:0.0:1788390343.253730:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788390343.253737:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103201152:12345-0@lo:503: 00000100:00100000:0.0:1788390343.253897:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103201152:12345-0@lo:503: Request processed in 160us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.253904:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390343.254035:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201152:0@lo:503: 00000100:00100000:1.0:1788390343.254561:0:8418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8418:1875263103201280:0@lo:502: 00000100:00100000:1.0:1788390343.254597:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.254623:0:8418:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.254674:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201280 00000100:00100000:0.0:1788390343.254679:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201280 00000100:00100000:0.0:1788390343.254744:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788390343.254752:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:8418:x1875263103201280:12345-0@lo:502: 00000100:00100000:0.0:1788390343.254933:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:8418:x1875263103201280:12345-0@lo:502: Request processed in 182us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.254940:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788390343.255025:0:8418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8418:1875263103201280:0@lo:502: 00000100:00100000:1.0:1788390343.255060:0:8418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8418:1875263103201408:0@lo:502: 00000100:00100000:1.0:1788390343.255096:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.255288:0:8418:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.255317:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201408 00000100:00100000:2.0:1788390343.255321:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201408 00000100:00100000:2.0:1788390343.255342:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788390343.255348:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:8418:x1875263103201408:12345-0@lo:502: 00000100:00100000:2.0:1788390343.255601:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:8418:x1875263103201408:12345-0@lo:502: Request processed in 253us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.255608:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788390343.255691:0:8418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8418:1875263103201408:0@lo:502: 00000040:00080000:1.0:1788390343.255714:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788390343.255864:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788390343.255886:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390343.255894:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.255904:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390343.255913:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788390343.255916:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788390343.255919:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788390343.255940:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.255948:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.255957:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.256154:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201536:0@lo:101: 00000100:00100000:2.0:1788390343.256183:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390343.256209:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.256232:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201536 00000100:00100000:3.0:1788390343.256238:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201536 00000100:00100000:3.0:1788390343.256269:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788390343.256274:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+13:5803:x1875263103201536:12345-0@lo:101: 00010000:00010000:3.0:1788390343.256282:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390343.256292:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd31cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31cd7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.256307:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd31cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cd7 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.256315:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd31cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cd7 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.256321:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1800, rc 0) 00000100:00100000:3.0:1788390343.256347:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103201536:12345-0@lo:101: Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.256358:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390343.256442:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201536:0@lo:101: 00010000:00010000:2.0:1788390343.256453:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.256462:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.256499:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201664:0@lo:501: 00000100:00100000:2.0:1788390343.256521:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390343.256577:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.256608:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201664 00000100:00100000:0.0:1788390343.256612:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201664 00000100:00100000:0.0:1788390343.256670:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788390343.256677:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103201664:12345-0@lo:501: 00000100:00100000:0.0:1788390343.256869:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103201664:12345-0@lo:501: Request processed in 193us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.256876:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788390343.256928:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201664:0@lo:501: 00000100:00100000:1.0:1788390343.256951:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201792:0@lo:503: 00000100:00100000:1.0:1788390343.257013:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.257207:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.257290:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201792 00000100:00100000:2.0:1788390343.257295:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201792 00000100:00100000:2.0:1788390343.257313:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788390343.257319:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103201792:12345-0@lo:503: 00000100:00100000:2.0:1788390343.257461:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103201792:12345-0@lo:503: Request processed in 141us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.257467:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788390343.257645:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103201792:0@lo:503: 00000100:00100000:1.0:1788390343.258100:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8419:1875263103201920:0@lo:502: 00000100:00100000:1.0:1788390343.258137:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.258156:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.258808:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103201920 00000100:00100000:2.0:1788390343.258815:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103201920 00000100:00100000:2.0:1788390343.258844:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788390343.258851:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8419:x1875263103201920:12345-0@lo:502: 00000100:00100000:2.0:1788390343.259050:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8419:x1875263103201920:12345-0@lo:502: Request processed in 199us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.259071:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788390343.259586:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8419:1875263103201920:0@lo:502: 00000020:01000000:1.0:1788390343.259612:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390343.259621:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.259623:0:8419:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788390343.259631:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788390343.259653:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8419:1875263103202048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.259690:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.259710:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.260062:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202048 00000100:00100000:2.0:1788390343.260067:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202048 00000100:00100000:2.0:1788390343.260089:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788390343.260096:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8419:x1875263103202048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390343.260524:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:8419:x1875263103202048:12345-0@lo:502:llog_process_th.0 Request processed in 427us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.260532:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788390343.260787:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8419:1875263103202048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390343.260809:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390343.260814:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.260816:0:8419:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390343.260821:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788390343.261116:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788390343.261134:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788390343.261143:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.261154:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390343.261163:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788390343.261166:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d69fc01000 from 39 10000000:01000000:2.0:1788390343.261169:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390343.261193:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.261202:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.261210:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.261271:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.261310:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390343.261939:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.262552:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202176 00000100:00100000:0.0:1788390343.262559:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202176 00000100:00100000:0.0:1788390343.262605:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390343.262614:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:5803:x1875263103202176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390343.262635:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390343.262648:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030000/0x9aafc5f04cd31cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31ce5 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.262671:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030000/0x9aafc5f04cd31cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31ce5 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.262681:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030000/0x9aafc5f04cd31cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31ce5 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.262690:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030000, rc 0) 00000100:00100000:0.0:1788390343.262737:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.262744:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788390343.262822:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390343.262836:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.262854:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.262906:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.262931:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.262978:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.263029:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202304 00000100:00100000:3.0:1788390343.263033:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202304 00000100:00100000:3.0:1788390343.263063:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788390343.263071:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.263298:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.263305:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788390343.263377:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.263401:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.263434:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.263459:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.263561:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202432 00000100:00100000:2.0:1788390343.263565:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202432 00000100:00100000:2.0:1788390343.263584:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788390343.263590:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.263726:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.263732:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788390343.263826:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.264129:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8420:1875263103202560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.264161:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.264188:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.264246:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202560 00000100:00100000:2.0:1788390343.264251:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202560 00000100:00100000:2.0:1788390343.264279:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788390343.264286:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8420:x1875263103202560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390343.264700:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8420:x1875263103202560:12345-0@lo:502:llog_process_th.0 Request processed in 413us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.264707:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788390343.264787:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8420:1875263103202560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.264823:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8420:1875263103202688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.264852:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.264876:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390343.264993:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202688 00000100:00100000:1.0:1788390343.264997:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202688 00000100:00100000:1.0:1788390343.265017:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788390343.265024:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8420:x1875263103202688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.265157:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:8420:x1875263103202688:12345-0@lo:502:llog_process_th.0 Request processed in 133us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390343.265164:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788390343.265508:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8420:1875263103202688:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788390343.265527:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788390343.265673:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788390343.265691:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390343.265698:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.265709:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390343.265725:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788390343.265727:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788390343.265730:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390343.265750:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.265823:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.265833:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.265847:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.265874:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.265931:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.266055:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202816 00000100:00100000:3.0:1788390343.266060:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202816 00000100:00100000:3.0:1788390343.266082:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788390343.266089:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:5803:x1875263103202816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390343.266096:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390343.266107:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd31cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31cf3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.266136:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd31cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cf3 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.266145:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd31cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31cf3 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.266153:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0200, rc 0) 00000100:00100000:3.0:1788390343.266233:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103202816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.266239:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788390343.266534:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390343.266548:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.266556:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.266599:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.266626:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.266698:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.266727:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103202944 00000100:00100000:2.0:1788390343.266731:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103202944 00000100:00100000:2.0:1788390343.266792:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788390343.266800:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103202944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.267028:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103202944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.267035:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788390343.267105:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103202944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.267128:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.267164:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.267471:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.267534:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203072 00000100:00100000:3.0:1788390343.267539:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203072 00000100:00100000:3.0:1788390343.267560:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788390343.267566:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103203072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.267708:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103203072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.267715:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788390343.267832:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.268137:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8421:1875263103203200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.268170:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.268195:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.268239:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203200 00000100:00100000:3.0:1788390343.268243:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203200 00000100:00100000:3.0:1788390343.268260:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788390343.268266:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8421:x1875263103203200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.268463:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8421:x1875263103203200:12345-0@lo:502:llog_process_th.0 Request processed in 196us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.268470:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788390343.268530:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8421:1875263103203200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390343.268548:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390343.268556:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.268558:0:8421:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788390343.268564:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788390343.268581:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8421:1875263103203328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.268611:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.268633:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.268711:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203328 00000100:00100000:2.0:1788390343.268715:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203328 00000100:00100000:2.0:1788390343.268735:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788390343.268741:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8421:x1875263103203328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390343.268885:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:8421:x1875263103203328:12345-0@lo:502:llog_process_th.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.268892:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788390343.269190:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8421:1875263103203328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390343.269209:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390343.269213:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.269215:0:8421:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390343.269230:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788390343.270001:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788390343.270021:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788390343.270038:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.270049:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390343.270059:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788390343.270062:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6a0d90000 from 39 10000000:01000000:3.0:1788390343.270064:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390343.270090:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.270099:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.270109:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390343.270125:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.270164:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.270199:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.270233:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203456 00000100:00100000:0.0:1788390343.270240:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203456 00000100:00100000:0.0:1788390343.270286:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390343.270296:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103203456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390343.270307:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390343.270319:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d01 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.270341:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d01 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.270350:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d01 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.270358:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030800, rc 0) 00000100:00100000:0.0:1788390343.270449:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103203456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.270456:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788390343.270777:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390343.270791:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.270799:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390343.270860:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.270898:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.270996:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.271336:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203584 00000100:00100000:0.0:1788390343.271340:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203584 00000100:00100000:0.0:1788390343.271405:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788390343.271413:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103203584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390343.271687:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103203584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.271696:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788390343.271724:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.271771:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.271812:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.275823:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.276021:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203712 00000100:00100000:3.0:1788390343.276031:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203712 00000100:00100000:3.0:1788390343.276080:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788390343.276090:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103203712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.276605:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103203712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 516us (4791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.276613:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788390343.276795:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103203712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.277165:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8422:1875263103203840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.277279:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.277312:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390343.277348:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203840 00000100:00100000:1.0:1788390343.277357:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203840 00000100:00100000:1.0:1788390343.277378:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788390343.277384:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8422:x1875263103203840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.277818:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8422:x1875263103203840:12345-0@lo:502:llog_process_th.0 Request processed in 432us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390343.277825:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788390343.278227:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8422:1875263103203840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.278263:0:8422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8422:1875263103203968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.278292:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.278307:0:8422:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.278350:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103203968 00000100:00100000:0.0:1788390343.278355:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103203968 00000100:00100000:0.0:1788390343.278409:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788390343.278416:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8422:x1875263103203968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390343.278632:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8422:x1875263103203968:12345-0@lo:502:llog_process_th.0 Request processed in 216us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.278639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788390343.278796:0:8422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8422:1875263103203968:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788390343.278814:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788390343.278936:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788390343.278954:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390343.278988:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.278998:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390343.279007:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788390343.279010:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788390343.279012:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390343.279034:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.279043:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.279050:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.279064:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.279091:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.279327:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.279370:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204096 00000100:00100000:3.0:1788390343.279374:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204096 00000100:00100000:3.0:1788390343.279392:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788390343.279398:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103204096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390343.279406:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390343.279417:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd31d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.279445:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd31d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d0f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.279455:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd31d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d0f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390343.279462:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1e00, rc 0) 00000100:00100000:3.0:1788390343.279507:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.279512:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788390343.279743:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390343.279755:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390343.279763:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390343.279805:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.279830:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.279850:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.279885:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204224 00000100:00100000:3.0:1788390343.279889:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204224 00000100:00100000:3.0:1788390343.279926:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788390343.279933:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.280229:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.280236:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788390343.280301:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.280325:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.280358:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.280386:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390343.280422:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204352 00000100:00100000:2.0:1788390343.280428:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204352 00000100:00100000:2.0:1788390343.280478:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788390343.280533:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.280676:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.280683:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788390343.280750:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390343.281057:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8423:1875263103204480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.281091:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390343.281114:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.281163:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204480 00000100:00100000:3.0:1788390343.281168:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204480 00000100:00100000:3.0:1788390343.281265:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788390343.281273:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8423:x1875263103204480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.281429:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8423:x1875263103204480:12345-0@lo:502:llog_process_th.0 Request processed in 157us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.281437:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788390343.281454:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8423:1875263103204480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390343.281479:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390343.281487:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.281490:0:8423:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788390343.281497:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788390343.281515:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8423:1875263103204608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390343.281545:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390343.281576:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204608 00000100:00100000:1.0:1788390343.281577:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.281582:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204608 00000100:00100000:3.0:1788390343.281770:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788390343.281777:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8423:x1875263103204608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390343.281898:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8423:x1875263103204608:12345-0@lo:502:llog_process_th.0 Request processed in 121us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.281905:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788390343.281927:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8423:1875263103204608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390343.281946:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390343.281950:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390343.281952:0:8423:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390343.281956:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788390343.282133:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788390343.282149:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788390343.282157:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.282167:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390343.282176:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788390343.282179:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d68a8e99b8 from 1 10000000:01000000:2.0:1788390343.282181:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788390343.282203:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.282211:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.282232:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.282252:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.282281:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390343.282307:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390343.282322:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204736 00000100:00100000:0.0:1788390343.282326:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204736 00000100:00100000:0.0:1788390343.282360:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788390343.282367:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103204736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390343.282374:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390343.282386:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31d24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d1d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.282405:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d1d expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.282424:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d1d expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390343.282433:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031800, rc 0) 00000100:00100000:0.0:1788390343.282469:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103204736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.282475:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788390343.282502:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390343.282514:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.282522:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.282561:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390343.282588:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390343.282648:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390343.282728:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204864 00000100:00100000:3.0:1788390343.282732:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204864 00000100:00100000:3.0:1788390343.282752:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788390343.282764:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103204864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390343.282942:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103204864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390343.282947:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788390343.283085:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103204864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788390343.283100:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788390343.283104:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390343.283109:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390343.629280:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103204992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390343.629413:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390343.629549:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103204992 00000100:00100000:0.0:1788390343.629558:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103204992 00000100:00100000:0.0:1788390343.629611:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390343.629622:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103204992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390343.629654:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390343.629710:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103204992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.629717:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788390343.629909:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc740a80 x1875263103204992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390343.629944:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103204992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390343.805142:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390343.805256:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739776 00000100:00100000:0.0:1788390343.805266:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739776 00000100:00100000:0.0:1788390343.805332:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:0.0:1788390343.805343:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:2357:x1875263093739776:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1788390343.805419:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:2357:x1875263093739776:12345-192.168.202.1@tcp:400: Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.805426:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:0.0:1788390343.807617:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390343.807656:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390343.807687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390343.807725:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740160 00000100:00100000:2.0:1788390343.807734:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740160 00000100:00100000:3.0:1788390343.807770:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093739904 00000100:00100000:3.0:1788390343.807775:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093739904 00000100:00100000:2.0:1788390343.807803:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740032 00000100:00100000:2.0:1788390343.807808:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740032 00000100:00100000:3.0:1788390343.807821:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390343.807834:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093739904:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1788390343.807837:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788390343.807850:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093740160:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1788390343.807915:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093740160:12345-192.168.202.1@tcp:400: Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390343.807923:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390343.807938:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390343.807950:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093740032:12345-192.168.202.1@tcp:400: 00000100:00100000:1.0:1788390343.808010:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093740032:12345-192.168.202.1@tcp:400: Request processed in 63us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390343.808017:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:0.0:1788390343.808209:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390343.808237:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390343.808239:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390343.808789:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093739904:12345-192.168.202.1@tcp:400: Request processed in 957us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390343.808797:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00010000:00010000:2.0:1788390344.141350:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390345.167851:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788390345.168067:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390345.171298:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103205120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390345.171471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390345.172519:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205120 00000100:00100000:0.0:1788390345.172533:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205120 00000100:00100000:0.0:1788390345.172722:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390345.172737:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103205120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390345.172786:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390345.172862:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103205120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390345.172870:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788390345.173031:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a825880 x1875263103205120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390345.173055:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103205120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390345.173291:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390346.189437:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390347.216462:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390347.383167:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390347.385371:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740288 00000100:00100000:3.0:1788390347.385392:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740288 00000100:00100000:3.0:1788390347.385504:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788390347.385518:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:5592:x1875263093740288:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1788390347.385540:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390347.385590:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd31d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe9f8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390347.385627:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd31d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f8 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390347.385641:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd31d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f8 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390347.385652:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390347.386062:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740288:12345-192.168.202.1@tcp:101: Request processed in 545us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390347.386070:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1788390347.393924:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390347.393990:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740416 00000100:00100000:3.0:1788390347.394004:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740416 00000100:00100000:3.0:1788390347.394078:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1788390347.394099:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740416:12345-192.168.202.1@tcp:501: 00000100:00100000:3.0:1788390347.394641:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740416:12345-192.168.202.1@tcp:501: Request processed in 552us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390347.394650:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788390347.397916:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390347.398013:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740544 00000100:00100000:3.0:1788390347.398028:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740544 00000100:00100000:3.0:1788390347.398153:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1788390347.398259:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740544:12345-192.168.202.1@tcp:503: 00000100:00100000:3.0:1788390347.398664:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740544:12345-192.168.202.1@tcp:503: Request processed in 408us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390347.398673:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788390347.403256:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390347.403531:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740672 00000100:00100000:0.0:1788390347.403545:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740672 00000100:00100000:0.0:1788390347.403622:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:0.0:1788390347.403634:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:6086:x1875263093740672:12345-192.168.202.1@tcp:502: 00000100:00100000:0.0:1788390347.404164:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:6086:x1875263093740672:12345-192.168.202.1@tcp:502: Request processed in 525us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390347.404173:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:1.0:1788390347.407826:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390347.407941:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740800 00000100:00100000:0.0:1788390347.407957:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740800 00000100:00100000:0.0:1788390347.408104:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:0.0:1788390347.408118:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:6086:x1875263093740800:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390347.408798:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:6086:x1875263093740800:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 680us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390347.408808:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:2.0:1788390347.422015:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390347.422426:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093740928 00000100:00100000:0.0:1788390347.422441:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093740928 00000100:00100000:0.0:1788390347.422529:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1788390347.422542:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093740928:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390347.422566:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390347.422592:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfe9ff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390347.422646:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9ff expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390347.422661:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9ff expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390347.422672:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031a00, rc 0) 00000100:00100000:0.0:1788390347.422877:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093740928:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 337us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390347.422885:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:1.0:1788390347.425911:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390347.429904:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741056 00000100:00100000:0.0:1788390347.429925:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741056 00000100:00100000:0.0:1788390347.430034:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:0.0:1788390347.430046:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093741056:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390347.430541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093741056:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 495us (4643us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390347.430550:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00010000:00010000:2.0:1788390348.237896:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390348.238165:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103205376:0@lo:400:kworker.0 00000100:00100000:1.0:1788390348.238200:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103205632:0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.238279:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103205504:0@lo:400:kworker.0 00000100:00100000:3.0:1788390348.238298:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103205248:0@lo:400:kworker.0 00000100:00100000:1.0:1788390348.240818:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390348.240951:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205632 00000100:00100000:1.0:1788390348.240976:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205632 00000100:00100000:1.0:1788390348.241050:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390348.241062:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103205632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390348.241139:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103205632:12345-0@lo:400:kworker.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390348.241167:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788390348.241201:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390348.241236:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc740a80 x1875263103205632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390348.241252:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103205632:0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.245379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390348.246271:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103205888:0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.246362:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390348.246429:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205888 00000100:00100000:0.0:1788390348.246439:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205888 00000100:00100000:0.0:1788390348.246508:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390348.246523:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103205888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.246590:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103205888:12345-0@lo:400:kworker.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390348.246598:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788390348.246623:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788390348.246662:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5aaa00 x1875263103205888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390348.246680:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103205888:0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.247397:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390348.247411:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390348.247457:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103205760:0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.248250:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205248 00000100:00100000:0.0:1788390348.248259:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205248 00000100:00100000:0.0:1788390348.248326:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788390348.248337:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103205248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.248407:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103205248:12345-0@lo:400:kworker.0 Request processed in 71us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390348.248416:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788390348.251884:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205376 00000100:00100000:1.0:1788390348.251905:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205376 00000100:00100000:3.0:1788390348.251906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390348.252029:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103205248:0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.252126:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205504 00000100:00100000:0.0:1788390348.252133:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205504 00000100:00100000:2.0:1788390348.252141:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103205760 00000100:00100000:2.0:1788390348.252146:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103205760 00000100:00100000:0.0:1788390348.252205:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390348.252220:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103205376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.252232:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390348.252243:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103205504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.252327:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103205504:12345-0@lo:400:kworker.0 Request processed in 87us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390348.252335:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390348.252359:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390348.252367:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103205760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788390348.252374:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390348.252404:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103205760:12345-0@lo:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390348.252410:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390348.252424:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103205504:0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.252435:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103205760:0@lo:400:kworker.0 00000100:00100000:2.0:1788390348.252471:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103205376:0@lo:400:kworker.0 00000100:00100000:0.0:1788390348.252559:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103205376:12345-0@lo:400:kworker.0 Request processed in 344us (7192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390348.252567:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390348.749236:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390348.749267:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103206016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390348.749359:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390348.749483:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206016 00000100:00100000:2.0:1788390348.749494:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206016 00000100:00100000:2.0:1788390348.749568:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390348.749581:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103206016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390348.749631:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390348.749687:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103206016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390348.749695:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788390348.749947:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cc380 x1875263103206016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390348.750004:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103206016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390348.919065:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390348.919117:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390348.919120:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741312 00000100:00100000:0.0:1788390348.919135:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741312 00000100:00100000:3.0:1788390348.919156:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390348.919207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390348.919237:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390348.919241:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741568 00000100:00100000:3.0:1788390348.919247:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741568 00000100:00100000:0.0:1788390348.919253:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093741312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390348.919285:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741440 00000100:00100000:3.0:1788390348.919289:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741440 00000100:00100000:3.0:1788390348.919303:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390348.919309:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093741568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390348.919350:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093741568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390348.919350:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093741312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390348.919362:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390348.919366:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390348.919383:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390348.919389:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093741440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390348.919404:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093741440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390348.919409:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00080000:3.0:1788390348.919424:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390348.919435:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390348.919437:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390348.919521:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741184 00000100:00100000:2.0:1788390348.919526:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741184 00000100:00100000:2.0:1788390348.919677:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:2.0:1788390348.919687:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093741184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390348.919720:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093741184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390348.919725:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000020:00000080:0.0:1788390349.027914:0:8462:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe990264d0 20000000:00000080:0.0:1788390349.027935:0:8462:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d68a823800 uarg=0000000000000000 20000000:01000000:0.0:1788390349.028005:0:8462:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390349.028013:0:8462:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390349.028018:0:8462:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788390349.028854:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788390349.029276:0:8462:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788390349.035591:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788390349.035663:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788390349.035718:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788390349.035740:0:8462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788390349.035766:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035787:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035809:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035816:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035827:0:8462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035837:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035889:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.035910:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 9 pid: 5801 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390349.035929:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206144:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390349.036094:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036103:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 18 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390349.036113:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206272:0@lo:104: 00000100:00100000:0.0:1788390349.036177:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390349.036232:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036246:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 18 pid: 5801 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390349.036255:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206400:0@lo:104: 00000100:00100000:0.0:1788390349.036283:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390349.036330:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390349.036344:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206272 00000100:00100000:0.0:1788390349.036354:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206272 00000100:00100000:0.0:1788390349.036407:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206400 00000100:00100000:0.0:1788390349.036411:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206400 00000100:00100000:0.0:1788390349.036431:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390349.036441:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:8462:x1875263103206272:12345-0@lo:104: 00010000:00010000:0.0:1788390349.036456:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036512:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390349.036518:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:8462:x1875263103206272:12345-0@lo:104: Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390349.036525:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390349.036543:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390349.036550:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8462:x1875263103206400:12345-0@lo:104: 00010000:00010000:0.0:1788390349.036557:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036587:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390349.036591:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8462:x1875263103206400:12345-0@lo:104: Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390349.036606:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788390349.036661:0:8462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036670:0:8462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 18 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390349.036679:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206528:0@lo:104: 00000100:00100000:0.0:1788390349.036702:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390349.036721:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206528 00000100:00100000:0.0:1788390349.036725:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206528 00000100:00100000:0.0:1788390349.036741:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788390349.036747:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8462:x1875263103206528:12345-0@lo:104: 00010000:00010000:0.0:1788390349.036755:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390349.036782:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788390349.036787:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:8462:x1875263103206528:12345-0@lo:104: Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390349.036792:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788390349.036812:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390349.036840:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206272:0@lo:104: 00000100:00100000:0.0:1788390349.036849:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206400:0@lo:104: 00000100:00100000:0.0:1788390349.036855:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206528:0@lo:104: 00010000:00010000:3.0:1788390349.037115:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390349.037124:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037132:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390349.037137:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037146:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390349.037155:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390349.037162:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390349.037209:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037282:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390349.037310:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037319:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813df000/0x9aafc5f04cd31bd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31bdb expref: -99 pid: 7583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037337:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390349.037341:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037360:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390349.037363:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037370:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390349.037375:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390349.037380:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390349.037398:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037404:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390349.037418:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037424:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31b09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31b10 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037436:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390349.037439:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037445:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390349.037448:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037465:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390349.037471:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390349.037476:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390349.037491:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037496:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390349.037501:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037507:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0c00/0x9aafc5f04cd31aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31aae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037527:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390349.037529:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390349.037531:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390349.037546:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103206656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390349.037586:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390349.037642:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206656 00000100:00100000:3.0:1788390349.037647:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206656 00010000:00010000:3.0:1788390349.037672:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 19 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390349.037696:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390349.037703:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103206656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390349.037722:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390349.037729:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 19 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037740:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 19 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037754:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31bdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31bd4 expref: 19 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.037769:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390349.037798:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3289:x1875263103206656:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390349.037806:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390349.037841:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103206656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390349.040608:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390349.040646:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103206784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390349.040747:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390349.040820:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390349.040828:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103206912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390349.040854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390349.040895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206784 00000100:00100000:2.0:1788390349.040906:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206784 00010000:00010000:2.0:1788390349.040954:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 18 pid: 5801 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390349.041007:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103206912 00000100:00100000:2.0:1788390349.041011:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103206912 00010000:00010000:2.0:1788390349.041029:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 19 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390349.041045:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390349.041055:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103206784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390349.041072:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390349.041078:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 19 pid: 5801 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041092:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 19 pid: 5801 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041113:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31b10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31b09 expref: 19 pid: 5801 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041134:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390349.041187:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3286:x1875263103206784:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390349.041213:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390349.041234:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390349.041240:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3286:x1875263103206912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390349.041247:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390349.041252:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 17 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041261:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 17 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041271:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd31aae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31aa7 expref: 17 pid: 5799 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.041280:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390349.041304:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103206912:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390349.041309:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390349.041360:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103206912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390349.041370:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103206784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390349.045833:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8462:1875263103206144:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390349.045888:0:8462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390349.046423:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390349.048311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741696 00000100:00100000:2.0:1788390349.048328:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741696 00010000:00010000:2.0:1788390349.048391:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390349.048439:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788390349.048450:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093741696:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390349.048489:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390349.048496:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048510:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048535:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd31c98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c7 expref: 10 pid: 5801 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048560:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048569:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048588:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048597:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048604:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048610:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048617:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680030200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390349.048621:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048640:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048666:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390349.048678:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390349.048767:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:2356:x1875263093741696:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 318us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390349.048776:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00010000:00010000:3.0:1788390349.048909:0:8462:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.048917:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.048921:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d39 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390349.262161:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390350.287791:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390350.301432:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103207040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390350.301505:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.301596:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207040 00000100:00100000:3.0:1788390350.301606:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207040 00000100:00100000:3.0:1788390350.301672:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390350.301682:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103207040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390350.301718:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390350.301760:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103207040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.301766:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788390350.301786:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390350.301814:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d687863100 x1875263103207040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390350.301832:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103207040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390350.395353:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390350.395388:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741824 00000100:00100000:3.0:1788390350.395398:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741824 00000100:00100000:3.0:1788390350.395448:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1788390350.395459:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:5592:x1875263093741824:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390350.395474:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390350.395493:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea06 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.395521:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.395546:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.395557:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390350.395610:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093741824:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.395618:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1788390350.398993:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390350.399136:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093741952 00000100:00100000:2.0:1788390350.399145:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093741952 00000100:00100000:2.0:1788390350.399203:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:2.0:1788390350.399213:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093741952:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390350.399508:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093741952:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 295us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390350.399516:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1788390350.406105:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390350.406512:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742080 00000100:00100000:0.0:1788390350.406523:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742080 00000100:00100000:0.0:1788390350.407253:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:0.0:1788390350.407266:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093742080:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390350.407463:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:5592:x1875263093742080:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 200us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390350.407472:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:1.0:1788390350.416946:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390350.417083:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742208 00000100:00100000:3.0:1788390350.417094:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742208 00000100:00100000:3.0:1788390350.417161:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:3.0:1788390350.417173:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:6149:x1875263093742208:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390350.417410:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:6149:x1875263093742208:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 239us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.417419:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:3.0:1788390350.421670:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390350.421883:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742336 00000100:00100000:0.0:1788390350.421893:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742336 00000100:00100000:0.0:1788390350.421949:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1788390350.421991:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:6149:x1875263093742336:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390350.422527:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:6149:x1875263093742336:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 566us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.422536:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 10000000:01000000:3.0:1788390350.735741:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788390350.735748:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a6b1a000 from 4 10000000:01000000:3.0:1788390350.735752:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390350.735792:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.735804:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.735816:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390350.735849:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.735911:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.735953:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f4029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.735997:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207168 00000100:00100000:3.0:1788390350.736003:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207168 00000100:00100000:3.0:1788390350.736047:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788390350.736197:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103207168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390350.736210:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390350.736222:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d47 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.736243:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.736253:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.736261:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390350.736305:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.736312:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788390350.736382:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390350.736395:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390350.736403:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390350.736454:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390350.736480:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.736501:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.736638:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207296 00000100:00100000:3.0:1788390350.736643:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207296 00000100:00100000:3.0:1788390350.736664:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788390350.736671:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.736884:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.736898:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788390350.737189:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390350.737217:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390350.737252:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.737269:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.737394:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207424 00000100:00100000:3.0:1788390350.737399:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207424 00000100:00100000:3.0:1788390350.737421:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788390350.737427:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.737561:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.737568:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788390350.737604:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390350.742740:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8571:1875263103207552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390350.742823:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390350.742868:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.742913:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207552 00000100:00100000:3.0:1788390350.742919:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207552 00000100:00100000:3.0:1788390350.742984:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788390350.742993:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8571:x1875263103207552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390350.743360:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8571:x1875263103207552:12345-0@lo:502:llog_process_th.0 Request processed in 368us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.743369:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788390350.743452:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8571:1875263103207552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390350.743478:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390350.743486:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390350.743488:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390350.743495:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6a6b1a000 00000020:00000080:0.0:1788390350.743498:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390350.743569:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8571:1875263103207680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390350.743599:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390350.743613:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390350.745383:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207680 00000100:00100000:1.0:1788390350.745392:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207680 00000100:00100000:1.0:1788390350.745433:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788390350.745442:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8571:x1875263103207680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390350.745630:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:8571:x1875263103207680:12345-0@lo:502:llog_process_th.0 Request processed in 190us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.745638:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788390350.745876:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8571:1875263103207680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390350.745902:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390350.745908:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390350.745910:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788390350.745915:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788390350.746996:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788390350.747027:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390350.747037:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390350.747049:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390350.747068:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390350.747071:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69fc01000 from 4 10000000:01000000:2.0:1788390350.747079:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390350.747110:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390350.747119:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390350.747128:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390350.747146:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390350.747199:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390350.747231:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.749248:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207808 00000100:00100000:3.0:1788390350.749260:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207808 00000100:00100000:3.0:1788390350.749312:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788390350.749322:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103207808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390350.749336:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390350.749351:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d55 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.749377:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.749395:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.749404:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390350.749462:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103207808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.749468:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788390350.749517:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390350.749532:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.749541:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390350.749604:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.749633:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.749650:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f4020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.749662:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103207936 00000100:00100000:3.0:1788390350.749664:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103207936 00000100:00100000:3.0:1788390350.749686:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788390350.749692:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103207936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.749908:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103207936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.749916:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788390350.749945:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103207936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.749996:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.750161:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.750176:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f4020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.750188:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208064 00000100:00100000:3.0:1788390350.750192:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208064 00000100:00100000:3.0:1788390350.750211:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788390350.750217:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103208064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.750344:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103208064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.750350:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788390350.750383:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390350.755462:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8573:1875263103208192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390350.755537:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.756175:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.760047:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208192 00000100:00100000:3.0:1788390350.760078:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208192 00000100:00100000:3.0:1788390350.760130:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788390350.760140:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8573:x1875263103208192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390350.760409:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8573:x1875263103208192:12345-0@lo:502:llog_process_th.0 Request processed in 270us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.760417:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788390350.760831:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8573:1875263103208192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390350.760866:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390350.760876:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390350.760879:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390350.760886:0:8573:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d69fc01000 00000020:00000080:1.0:1788390350.760889:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390350.760984:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8573:1875263103208320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390350.761028:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.761068:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390350.762140:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208320 00000100:00100000:3.0:1788390350.762159:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208320 00000100:00100000:3.0:1788390350.762206:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788390350.762215:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8573:x1875263103208320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390350.762418:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:8573:x1875263103208320:12345-0@lo:502:llog_process_th.0 Request processed in 203us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.762426:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788390350.763018:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8573:1875263103208320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390350.763157:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390350.763165:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390350.763167:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788390350.763172:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788390350.763693:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788390350.763712:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390350.763722:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.763734:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390350.763744:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788390350.763747:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a0d90000 from 4 10000000:01000000:3.0:1788390350.763750:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390350.763781:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.763789:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.763798:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390350.763816:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.763859:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.763897:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390350.763945:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208448 00000100:00100000:1.0:1788390350.763951:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208448 00000100:00100000:1.0:1788390350.764012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788390350.764020:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103208448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390350.764040:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390350.764164:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31d63 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390350.764189:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390350.764197:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390350.764206:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173a600, rc 0) 00000100:00100000:1.0:1788390350.764243:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103208448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.764249:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788390350.764321:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390350.764333:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390350.764342:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390350.764395:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.764419:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.764446:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390350.764485:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208576 00000100:00100000:1.0:1788390350.764489:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208576 00000100:00100000:1.0:1788390350.764542:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788390350.764548:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103208576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390350.764765:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103208576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.764772:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788390350.764823:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.764846:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.764878:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.769046:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390350.769234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208704 00000100:00100000:2.0:1788390350.769243:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208704 00000100:00100000:2.0:1788390350.769289:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788390350.769299:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103208704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390350.769514:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103208704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (4634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390350.769522:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788390350.771157:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103208704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390350.772240:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8575:1875263103208832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390350.772303:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.772339:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390350.772408:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208832 00000100:00100000:2.0:1788390350.772414:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208832 00000100:00100000:2.0:1788390350.772447:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788390350.772456:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:8575:x1875263103208832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390350.772631:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:8575:x1875263103208832:12345-0@lo:502:llog_process_th.0 Request processed in 176us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390350.772639:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788390350.772721:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8575:1875263103208832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390350.772742:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390350.772751:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390350.772753:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788390350.772761:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6a0d90000 00000020:00000080:3.0:1788390350.772763:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788390350.772827:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8575:1875263103208960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390350.772858:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.772870:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390350.772916:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103208960 00000100:00100000:2.0:1788390350.772925:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103208960 00000100:00100000:2.0:1788390350.772952:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788390350.772981:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:8575:x1875263103208960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390350.773198:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:8575:x1875263103208960:12345-0@lo:502:llog_process_th.0 Request processed in 239us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390350.773204:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788390350.773431:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:8575:1875263103208960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390350.773450:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390350.773454:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390350.773462:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788390350.773466:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788390350.773591:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788390350.773606:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390350.773615:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390350.773626:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390351.310732:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390352.336855:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390353.357396:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103209088:0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.357619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390353.358354:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103209216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.358391:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390353.358519:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103209728:0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.358546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390353.358579:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390353.358585:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103209344:0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.358607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390353.358640:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209216 00000100:00100000:0.0:1788390353.358647:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209216 00000100:00100000:0.0:1788390353.358690:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209344 00000100:00100000:0.0:1788390353.358693:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209344 00000100:00100000:0.0:1788390353.358722:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390353.358731:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103209216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.358891:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103209600:0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.358917:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390353.358928:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390353.358933:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103209472:0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.358954:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390353.358993:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390353.359004:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209728 00000100:00100000:3.0:1788390353.359007:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209728 00000100:00100000:3.0:1788390353.359034:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209472 00000100:00100000:3.0:1788390353.359037:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209472 00000100:00100000:3.0:1788390353.359053:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390353.359060:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103209728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.359092:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103209728:12345-0@lo:400:kworker.0 Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390353.359099:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390353.359114:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390353.359120:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103209472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.359165:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103209472:12345-0@lo:400:kworker.0 Request processed in 45us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390353.359172:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788390353.359507:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a827100 x1875263103209472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390353.359683:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103209472:0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.359863:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103209216:12345-0@lo:400:kworker.0 Request processed in 51us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390353.359872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390353.359886:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209600 00000100:00100000:0.0:1788390353.359890:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209600 00000100:00100000:0.0:1788390353.359909:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390353.359915:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103209344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.359989:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103209344:12345-0@lo:400:kworker.0 Request processed in 74us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390353.359996:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390353.360008:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390353.360014:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103209600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.360048:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103209600:12345-0@lo:400:kworker.0 Request processed in 35us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390353.360063:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788390353.360089:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390353.360092:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390353.360095:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390353.360114:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103209344:0@lo:400:kworker.0 00000100:00100000:0.0:1788390353.360136:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103209216:0@lo:400:kworker.0 00010000:00080000:0.0:1788390353.360149:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682e94a80 x1875263103209728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390353.360158:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103209728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390353.360510:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103209600:0@lo:400:kworker.0 00000100:00100000:1.0:1788390353.362841:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209088 00000100:00100000:1.0:1788390353.362857:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209088 00000100:00100000:1.0:1788390353.363046:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788390353.363058:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103209088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390353.363151:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103209088:12345-0@lo:400:kworker.0 Request processed in 96us (5532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390353.363168:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788390353.364907:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103209088:0@lo:400:kworker.0 00000001:02000400:0.0:1788390353.433265:0:8763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788390353.869602:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390353.869626:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103209856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390353.869692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390353.869815:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209856 00000100:00100000:2.0:1788390353.869823:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209856 00000100:00100000:2.0:1788390353.869874:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390353.869884:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103209856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390353.869917:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390353.870546:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103209856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 661us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390353.870555:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788390353.870615:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cd500 x1875263103209856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390353.870634:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103209856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390354.040696:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390354.040753:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390354.040792:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390354.040825:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742464 00000100:00100000:1.0:1788390354.040837:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390354.040843:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742464 00000100:00100000:1.0:1788390354.040877:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742720 00000100:00100000:1.0:1788390354.040887:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742720 00000100:00100000:0.0:1788390354.040932:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1788390354.040948:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093742464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390354.040955:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742848 00000100:00100000:1.0:1788390354.041013:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742848 00000100:00100000:0.0:1788390354.041099:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093742464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 154us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390354.041116:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390354.041117:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788390354.041144:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093742720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:0.0:1788390354.041179:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390354.041190:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390354.041206:0:6652:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788390354.041214:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093742720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390354.041217:0:6652:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788390354.041230:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390354.041254:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788390354.041261:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093742848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390354.041294:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093742848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390354.041301:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390354.041624:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742592 00000100:00100000:2.0:1788390354.041632:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742592 00000100:00100000:2.0:1788390354.041697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788390354.041708:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093742592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390354.041758:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093742592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 53us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390354.041766:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00080000:0.0:1788390354.041895:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788390354.386099:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390355.410486:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390355.411953:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390355.412006:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103209984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390355.412101:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390355.412249:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103209984 00000100:00100000:1.0:1788390355.412261:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103209984 00000100:00100000:1.0:1788390355.412341:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390355.412369:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103209984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390355.412421:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390355.412475:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103209984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390355.412482:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788390355.412670:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390355.412708:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a9f80 x1875263103209984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390355.412730:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103209984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390356.439039:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390357.453080:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390358.450756:0:9007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing yml_node 00000100:00100000:1.0:1788390358.479352:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103210112:0@lo:400:kworker.0 00010000:00010000:3.0:1788390358.481219:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390358.481315:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390358.481381:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103210624:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.481431:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390358.481526:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210112 00000100:00100000:3.0:1788390358.481534:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210112 00000100:00100000:3.0:1788390358.481589:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788390358.481599:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103210112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390358.481658:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103210112:12345-0@lo:400:kworker.0 Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.481667:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788390358.481771:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103210112:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.481789:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390358.481797:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103210496:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.481824:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390358.481863:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103210240:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.481886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390358.481905:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103210752:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.481925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390358.481943:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390358.481949:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103210368:0@lo:400:kworker.0 00000100:00100000:3.0:1788390358.482075:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210624 00000100:00100000:3.0:1788390358.482091:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210624 00000100:00100000:3.0:1788390358.482128:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210240 00000100:00100000:3.0:1788390358.482131:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210240 00000100:00100000:3.0:1788390358.482148:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390358.482155:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103210624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390358.482195:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103210624:12345-0@lo:400:kworker.0 Request processed in 40us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.482212:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390358.482230:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390358.482236:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103210240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390358.482264:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103210240:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.482270:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788390358.482300:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390358.482328:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103210624:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.482514:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390358.482544:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103210240:0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.482571:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210368 00000100:00100000:1.0:1788390358.482574:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210368 00000100:00100000:1.0:1788390358.482610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390358.482617:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.482652:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103210368:12345-0@lo:400:kworker.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390358.482657:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390358.482677:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210496 00000100:00100000:1.0:1788390358.482680:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210496 00000100:00100000:1.0:1788390358.482702:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210752 00000100:00100000:1.0:1788390358.482705:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210752 00000100:00100000:1.0:1788390358.482723:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390358.482729:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103210496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.482759:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103210496:12345-0@lo:400:kworker.0 Request processed in 30us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390358.482764:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390358.482774:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390358.482780:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390358.482804:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103210752:12345-0@lo:400:kworker.0 Request processed in 25us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390358.482810:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390358.482832:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103210368:0@lo:400:kworker.0 00010000:00080000:1.0:1788390358.482844:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a8700 x1875263103210752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390358.482854:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103210752:0@lo:400:kworker.0 00000100:00080000:3.0:1788390358.482926:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390358.482929:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390358.482931:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788390358.482951:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a9180 x1875263103210496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390358.483142:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103210496:0@lo:400:kworker.0 00000100:00100000:2.0:1788390358.991706:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103210880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390358.991805:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390358.991942:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103210880 00000100:00100000:3.0:1788390358.991952:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103210880 00000100:00100000:3.0:1788390358.992035:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390358.992045:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103210880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390358.992101:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390358.992152:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103210880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.992161:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788390358.992187:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cfb80 x1875263103210880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390358.992207:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103210880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390359.166300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390359.167676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390359.167711:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743104 00000100:00100000:2.0:1788390359.167721:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743104 00000100:00100000:2.0:1788390359.167788:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788390359.167799:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093743104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390359.167877:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093743104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390359.167885:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00080000:2.0:1788390359.167905:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390359.171325:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093742976 00000100:00100000:3.0:1788390359.171337:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093742976 00000100:00100000:3.0:1788390359.171381:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788390359.171387:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093742976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390359.171452:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2359:x1875263093742976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (5162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390359.171457:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788390359.171515:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390359.171600:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390359.171614:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743232 00000100:00100000:3.0:1788390359.171617:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743232 00000100:00100000:3.0:1788390359.171647:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743360 00000100:00100000:3.0:1788390359.171651:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743360 00000100:00100000:3.0:1788390359.171673:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390359.171680:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2355:x1875263093743232:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1788390359.172060:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31ca6 00000100:00080000:3.0:1788390359.172068:0:6652:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf7d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390359.172141:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788390359.172619:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+2:2355:x1875263093743232:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 938us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390359.172628:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390359.172645:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390359.172654:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2355:x1875263093743360:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1788390359.172671:0:6652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31cad 00000100:00080000:3.0:1788390359.172678:0:6652:0:(import.c:65:import_set_state_nolock()) ffff95d5810a7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390359.172699:0:6652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788390359.172892:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+2:2355:x1875263093743360:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 238us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390359.172899:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00080000:3.0:1788390359.172918:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390359.172926:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390359.173017:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390359.173023:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390359.501146:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788390359.534790:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:3.0:1788390359.534800:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6bbf7f000/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:1.0:1788390359.534840:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbf7f000/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-OST0000 00000020:00000080:1.0:1788390359.534885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbf7d800 for lustre-OST0000 00000100:00100000:1.0:1788390360.527126:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390360.527168:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103211008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390360.527242:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390360.527317:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211008 00000100:00100000:1.0:1788390360.527325:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211008 00000100:00100000:1.0:1788390360.527382:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390360.527390:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103211008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390360.527428:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390360.527477:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103211008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00080000:0.0:1788390360.527478:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390360.527488:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788390360.527521:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a8700 x1875263103211008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390360.527542:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103211008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390360.528586:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390361.333440:0:9201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:0.0:1788390361.550525:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390362.573540:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390363.159091:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:1.0:1788390363.159105:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d5810a1800/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:1.0:1788390363.159152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5810a1800/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-OST0001 00000020:00000080:1.0:1788390363.159218:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5810a7800 for lustre-OST0001 00000001:02000400:2.0:1788390363.266146:0:9300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:0.0:1788390363.600185:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390363.605277:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103211264:0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605345:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390363.605432:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103211776:0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390363.605524:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390363.605531:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103211392:0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605554:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390363.605584:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211264 00000100:00100000:3.0:1788390363.605591:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211264 00000100:00100000:3.0:1788390363.605643:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211392 00000100:00100000:3.0:1788390363.605647:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211392 00000100:00100000:3.0:1788390363.605675:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390363.605684:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103211264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605734:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103211264:12345-0@lo:400:kworker.0 Request processed in 50us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390363.605741:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390363.605761:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390363.605767:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103211392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605791:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103211392:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390363.605803:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390363.605821:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211776 00000100:00100000:3.0:1788390363.605825:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211776 00000100:00100000:3.0:1788390363.605850:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390363.605856:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103211776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605885:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103211776:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390363.605890:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390363.605937:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103211392:0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.605947:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103211264:0@lo:400:kworker.0 00010000:00080000:3.0:1788390363.605977:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a826680 x1875263103211776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390363.605988:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103211776:0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606132:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103211136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606165:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390363.606197:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103211648:0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606219:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390363.606236:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390363.606242:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103211520:0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606260:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390363.606281:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211520 00000100:00100000:1.0:1788390363.606284:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211520 00000100:00100000:1.0:1788390363.606311:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390363.606318:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103211520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606353:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103211520:12345-0@lo:400:kworker.0 Request processed in 35us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390363.606366:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788390363.606395:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a825880 x1875263103211520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390363.606404:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103211520:0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606417:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211648 00000100:00100000:1.0:1788390363.606420:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211648 00000100:00100000:1.0:1788390363.606441:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390363.606447:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103211648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390363.606479:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103211648:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390363.606485:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390363.606510:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103211648:0@lo:400:kworker.0 00000100:00080000:1.0:1788390363.606547:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390363.606551:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390363.606553:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390363.606600:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211136 00000100:00100000:3.0:1788390363.606604:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211136 00000100:00100000:3.0:1788390363.606638:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788390363.606645:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103211136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390363.606678:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103211136:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390363.606683:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788390363.606752:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103211136:0@lo:400:kworker.0 00000100:00100000:2.0:1788390364.109097:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103211904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390364.109172:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390364.109546:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103211904 00000100:00100000:0.0:1788390364.109554:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103211904 00000100:00100000:0.0:1788390364.109600:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788390364.109610:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103211904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390364.109644:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390364.109691:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103211904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390364.109697:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788390364.109735:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cca80 x1875263103211904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390364.109753:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103211904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390364.280898:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390364.280947:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390364.281080:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743616 00000100:00100000:2.0:1788390364.281091:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743616 00000100:00100000:2.0:1788390364.281162:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1788390364.281174:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093743616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390364.281248:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093743616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390364.281255:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00080000:1.0:1788390364.283105:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390364.283338:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743488 00000100:00100000:0.0:1788390364.283347:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743488 00000100:00100000:0.0:1788390364.283415:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1788390364.283425:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093743488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390364.283482:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093743488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390364.283490:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00010000:00010000:2.0:1788390364.621108:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390365.245806:0:9397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:3.0:1788390365.645201:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390365.645254:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390365.645277:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103212032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390365.645345:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390365.647614:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212032 00000100:00100000:0.0:1788390365.647677:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212032 00000100:00100000:0.0:1788390365.647831:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390365.647844:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103212032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390365.647898:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390365.648008:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103212032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.648028:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788390365.649121:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682e94a80 x1875263103212032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390365.649168:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103212032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390365.650823:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788390366.323471:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 19:06:05 EDT 2026 00010000:00010000:2.0:1788390366.672206:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390367.698429:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390368.718660:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103212416:0@lo:400:kworker.0 00000100:00100000:3.0:1788390368.718739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390368.718812:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788390368.718820:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103212288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390368.718842:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390368.718883:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103212800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.719092:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212416 00000100:00100000:0.0:1788390368.719101:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212416 00000100:00100000:0.0:1788390368.719168:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212288 00000100:00100000:0.0:1788390368.719172:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212288 00000100:00100000:0.0:1788390368.719195:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390368.719205:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103212416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.719256:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103212416:12345-0@lo:400:kworker.0 Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390368.719263:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390368.719279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390368.719285:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103212288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.719311:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103212288:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390368.719316:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788390368.719331:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390368.719560:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103212160:0@lo:400:kworker.0 00000100:00100000:2.0:1788390368.719606:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390368.719632:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103212672:0@lo:400:kworker.0 00000100:00100000:2.0:1788390368.719655:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390368.719672:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390368.719678:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103212544:0@lo:400:kworker.0 00000100:00100000:2.0:1788390368.719701:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390368.719722:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212672 00000100:00100000:1.0:1788390368.719726:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212672 00000100:00100000:2.0:1788390368.719728:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212544 00000100:00100000:2.0:1788390368.719731:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212544 00000100:00100000:1.0:1788390368.719759:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390368.719766:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103212672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390368.719776:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390368.719783:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103212544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390368.719807:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103212672:12345-0@lo:400:kworker.0 Request processed in 42us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390368.719808:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103212544:12345-0@lo:400:kworker.0 Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390368.719813:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390368.719827:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788390368.719949:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fc74e00 x1875263103212544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390368.719981:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103212544:0@lo:400:kworker.0 00000100:00100000:2.0:1788390368.720005:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103212672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.720055:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212160 00000100:00100000:0.0:1788390368.720059:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212160 00000100:00100000:0.0:1788390368.720096:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788390368.720104:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103212160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.720139:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103212160:12345-0@lo:400:kworker.0 Request processed in 36us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390368.720145:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788390368.720172:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390368.720182:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390368.720243:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103212160:0@lo:400:kworker.0 00000100:00100000:3.0:1788390368.720260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390368.720303:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103212416:0@lo:400:kworker.0 00010000:00010000:1.0:1788390368.720307:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390368.720322:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103212288:0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.721531:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212800 00000100:00100000:0.0:1788390368.721550:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212800 00000100:00100000:0.0:1788390368.721612:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390368.721623:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103212800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390368.721692:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103212800:12345-0@lo:400:kworker.0 Request processed in 72us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390368.721699:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788390368.721902:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788390368.722006:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fc76a00 x1875263103212800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390368.722020:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103212800:0@lo:400:kworker.0 00000100:00100000:3.0:1788390369.230196:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390369.230267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390369.230336:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103212928 00000100:00100000:3.0:1788390369.230343:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103212928 00000100:00100000:3.0:1788390369.230431:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390369.230441:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103212928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390369.230475:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390369.230519:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103212928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390369.230534:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788390369.230658:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cd880 x1875263103212928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390369.230678:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390369.397918:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390369.398045:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390369.398097:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743744 00000100:00100000:0.0:1788390369.398105:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743744 00000100:00100000:0.0:1788390369.398149:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:0.0:1788390369.398160:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093743744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390369.398222:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093743744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390369.398228:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:3.0:1788390369.399017:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093743872 00000100:00100000:3.0:1788390369.399022:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093743872 00000100:00100000:1.0:1788390369.399109:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788390369.399119:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093743872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390369.399172:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093743872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390369.399180:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00080000:2.0:1788390369.399240:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390369.741381:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390370.765507:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390370.767221:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390370.767243:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103213056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390370.767309:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390370.767362:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213056 00000100:00100000:2.0:1788390370.767372:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213056 00000100:00100000:2.0:1788390370.767443:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390370.767454:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103213056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390370.767489:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390370.767535:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103213056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390370.767541:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788390370.767594:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390370.768298:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a9180 x1875263103213056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390370.768317:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103213056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390371.791505:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390372.814122:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390373.837228:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390373.837381:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103213184:0@lo:400:kworker.0 00000100:00100000:2.0:1788390373.837451:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390373.837582:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213184 00000100:00100000:0.0:1788390373.837591:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213184 00000100:00100000:3.0:1788390373.837650:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390373.837691:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788390373.837701:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103213184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390373.837755:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103213184:12345-0@lo:400:kworker.0 Request processed in 56us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390373.837762:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788390373.839364:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390373.839428:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103213440:0@lo:400:kworker.0 00000100:00100000:0.0:1788390373.839484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390373.839557:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103213184:0@lo:400:kworker.0 00000100:00100000:2.0:1788390373.840186:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213440 00000100:00100000:2.0:1788390373.840194:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213440 00000100:00100000:2.0:1788390373.840250:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390373.840260:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390373.840311:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103213440:12345-0@lo:400:kworker.0 Request processed in 53us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390373.840328:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788390373.840440:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390373.840468:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103213440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390373.842584:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103213312:0@lo:400:kworker.0 00000100:00100000:3.0:1788390373.842651:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390373.842774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213312 00000100:00100000:2.0:1788390373.842785:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213312 00000100:00100000:2.0:1788390373.842887:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788390373.842897:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390373.843010:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103213312:12345-0@lo:400:kworker.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390373.843019:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390373.843046:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103213312:0@lo:400:kworker.0 00000100:00100000:3.0:1788390373.843339:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103213568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390373.843382:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390373.843421:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213568 00000100:00100000:2.0:1788390373.843426:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213568 00000100:00100000:2.0:1788390373.843506:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390373.843514:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103213568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390373.843558:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390373.843582:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103213696:0@lo:400:kworker.0 00000100:00100000:1.0:1788390373.843610:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103213824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390373.843617:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390373.843650:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390373.843657:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213696 00000100:00100000:0.0:1788390373.843662:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213696 00000100:00100000:1.0:1788390373.843691:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213824 00000100:00100000:1.0:1788390373.843697:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213824 00000100:00100000:0.0:1788390373.843702:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390373.843712:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103213696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390373.843733:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390373.843743:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103213824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390373.843755:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103213696:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390373.843763:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788390373.843788:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390373.843789:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103213824:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00080000:0.0:1788390373.843793:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390373.843800:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390373.843815:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103213696:0@lo:400:kworker.0 00010000:00080000:1.0:1788390373.843844:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a9f80 x1875263103213824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390373.843856:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103213824:0@lo:400:kworker.0 00000100:00100000:2.0:1788390373.844064:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103213568:12345-0@lo:400:kworker.0 Request processed in 551us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390373.844070:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788390373.844103:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a8380 x1875263103213568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390373.844168:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103213568:0@lo:400:kworker.0 00000100:00100000:1.0:1788390374.349842:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103213952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390374.349913:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390374.350064:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103213952 00000100:00100000:3.0:1788390374.350073:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103213952 00000100:00100000:3.0:1788390374.350142:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390374.350153:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103213952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390374.350187:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390374.352460:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103213952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2296us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390374.352490:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788390374.352571:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6ced80 x1875263103213952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390374.352652:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103213952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390374.521058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390374.521161:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390374.521367:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744128 00000100:00100000:0.0:1788390374.521378:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744128 00000100:00100000:0.0:1788390374.521460:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390374.521472:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093744128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.521553:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093744128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.521562:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00080000:1.0:1788390374.521941:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390374.522224:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744000 00000100:00100000:3.0:1788390374.522231:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744000 00000100:00100000:3.0:1788390374.522270:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1788390374.522279:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093744000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390374.522328:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093744000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390374.522336:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00010000:00010000:3.0:1788390374.862098:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390375.008484:0:10077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:06:14 (1788390374) === 00000100:00100000:1.0:1788390375.348894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390375.349000:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744256 00000100:00100000:0.0:1788390375.349010:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744256 00000100:00100000:0.0:1788390375.349076:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:0.0:1788390375.349086:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:8142:x1875263093744256:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390375.349102:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390375.349118:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.349146:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea0d expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.349156:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea0d expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.349175:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030200, rc 0) 00000100:00100000:0.0:1788390375.349227:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744256:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 142us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390375.349233:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:0.0:1788390375.354695:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.354842:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744384 00000100:00100000:3.0:1788390375.354853:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744384 00000100:00100000:3.0:1788390375.355039:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788390375.355051:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744384:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390375.355350:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744384:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 301us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.355359:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1788390375.362461:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390375.362622:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744512 00000100:00100000:2.0:1788390375.362633:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744512 00000100:00100000:2.0:1788390375.362696:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:2.0:1788390375.362707:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744512:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390375.362953:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744512:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 247us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390375.363011:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:1.0:1788390375.365743:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.366100:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744640 00000100:00100000:3.0:1788390375.366111:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744640 00000100:00100000:3.0:1788390375.366238:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:3.0:1788390375.366249:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8146:x1875263093744640:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390375.366583:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8146:x1875263093744640:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 335us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.366592:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:0.0:1788390375.391747:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390375.391851:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744768 00000100:00100000:2.0:1788390375.391862:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744768 00000100:00100000:2.0:1788390375.392001:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:2.0:1788390375.392012:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8146:x1875263093744768:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390375.392312:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8146:x1875263093744768:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 302us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390375.392320:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:1.0:1788390375.398183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.398267:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093744896 00000100:00100000:3.0:1788390375.398278:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093744896 00000100:00100000:3.0:1788390375.398346:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:3.0:1788390375.398356:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:8142:x1875263093744896:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390375.398372:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390375.398389:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea37 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390375.398416:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea37 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390375.398426:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea37 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390375.398433:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788390375.398481:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:8142:x1875263093744896:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.398486:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:1.0:1788390375.404210:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390375.404305:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745024 00000100:00100000:2.0:1788390375.404316:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745024 00000100:00100000:2.0:1788390375.404373:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:2.0:1788390375.404383:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:8142:x1875263093745024:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788390375.404409:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788390375.404432:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788390375.404437:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788390375.404440:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788390375.404442:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788390375.407610:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:8142:x1875263093745024:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 3216us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390375.407626:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:1.0:1788390375.414682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390375.414892:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745152 00000100:00100000:0.0:1788390375.414904:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745152 00000100:00100000:0.0:1788390375.415096:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:0.0:1788390375.415108:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:8142:x1875263093745152:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390375.415135:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390375.415153:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea3e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.415183:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.415213:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390375.415223:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030a00, rc 0) 00000100:00100000:0.0:1788390375.415279:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8142:x1875263093745152:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 173us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390375.415286:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:0.0:1788390375.416806:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390375.417275:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745280 00000100:00100000:1.0:1788390375.417284:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745280 00000100:00100000:1.0:1788390375.417368:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:1.0:1788390375.417378:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8142:x1875263093745280:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788390375.417698:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8142:x1875263093745280:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 321us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390375.417706:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:3.0:1788390375.422059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390375.423601:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745408 00000100:00100000:0.0:1788390375.423614:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745408 00000100:00100000:0.0:1788390375.423677:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:0.0:1788390375.423689:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8142:x1875263093745408:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390375.423914:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8142:x1875263093745408:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 227us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390375.423938:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:2.0:1788390375.427622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390375.427711:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745536 00000100:00100000:1.0:1788390375.427733:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745536 00000100:00100000:1.0:1788390375.427833:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788390375.427845:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8150:x1875263093745536:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390375.428112:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8150:x1875263093745536:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 269us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390375.428120:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788390375.431197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.431687:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745664 00000100:00100000:3.0:1788390375.431697:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745664 00000100:00100000:3.0:1788390375.431739:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:3.0:1788390375.431746:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8150:x1875263093745664:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390375.432011:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:8150:x1875263093745664:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 263us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.432019:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:3.0:1788390375.434325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390375.434402:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745792 00000100:00100000:0.0:1788390375.434412:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745792 00000100:00100000:0.0:1788390375.434507:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390375.434515:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2355:x1875263093745792:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788390375.434541:0:8163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a1ff6842-4530-4584-9014-31d80c6aefa2@192.168.202.1@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1788390375.434573:0:8163:0:(genops.c:1385:class_connect()) connect: client a1ff6842-4530-4584-9014-31d80c6aefa2, cookie 0x9aafc5f04cd31d86 00000004:00100000:0.0:1788390375.434600:0:8163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788390375.434840:0:8163:0:(import.c:65:import_set_state_nolock()) ffff95d6b6535800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390375.434893:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2355:x1875263093745792:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 378us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390375.434923:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390375.439264:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390375.439349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.439496:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746048 00000100:00100000:3.0:1788390375.439504:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746048 00000100:00100000:3.0:1788390375.439562:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093745920 00000100:00100000:3.0:1788390375.439565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093745920 00000100:00100000:3.0:1788390375.439583:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390375.439594:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+7:8142:x1875263093746048:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788390375.439630:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788390375.439691:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+7:8142:x1875263093746048:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 100us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.439696:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390375.439709:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390375.439713:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:0:x1875263093745920:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788390375.439720:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788390375.439731:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:0:x1875263093745920:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 19us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.439735:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00080000:1.0:1788390375.439882:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390375.441053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.441111:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746176 00000100:00100000:3.0:1788390375.441115:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746176 00000100:00100000:3.0:1788390375.441169:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390375.441175:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:8142:x1875263093746176:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788390375.441218:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:8142:x1875263093746176:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390375.441222:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390375.443604:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.443688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390375.443720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390375.443758:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746560 00000100:00100000:0.0:1788390375.443765:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746560 00000100:00100000:0.0:1788390375.443810:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788390375.443816:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+6:8142:x1875263093746560:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788390375.443874:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788390375.443984:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+6:8142:x1875263093746560:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 138us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390375.443992:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390375.444338:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746304 00000100:00100000:1.0:1788390375.444343:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746304 00000100:00100000:1.0:1788390375.444382:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746432 00000100:00100000:1.0:1788390375.444385:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746432 00000100:00100000:1.0:1788390375.444403:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390375.444408:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263093746304:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788390375.444430:0:6653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a1ff6842-4530-4584-9014-31d80c6aefa2@192.168.202.1@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1788390375.444459:0:6653:0:(genops.c:1385:class_connect()) connect: client a1ff6842-4530-4584-9014-31d80c6aefa2, cookie 0x9aafc5f04cd31d8d 00002000:00100000:1.0:1788390375.444470:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1ff6842-4530-4584-9014-31d80c6aefa2/ffff95d6bc73a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390375.444493:0:6653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788390375.444541:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788390375.444547:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093746432:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390375.444562:0:6650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a1ff6842-4530-4584-9014-31d80c6aefa2@192.168.202.1@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1788390375.444634:0:6650:0:(genops.c:1385:class_connect()) connect: client a1ff6842-4530-4584-9014-31d80c6aefa2, cookie 0x9aafc5f04cd31d94 00002000:00100000:2.0:1788390375.444640:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1ff6842-4530-4584-9014-31d80c6aefa2/ffff95d6a0f52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390375.444646:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390375.444696:0:6653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390375.444721:0:6653:0:(import.c:65:import_set_state_nolock()) ffff95d6bc738000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390375.444759:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2355:x1875263093746304:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 349us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390375.444766:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00002000:00080000:2.0:1788390375.444821:0:6650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788390375.444835:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6a0f53800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390375.444859:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2355:x1875263093746432:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 310us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390375.444881:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390375.885703:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103214080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390375.885799:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390375.885996:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214080 00000100:00100000:2.0:1788390375.886008:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214080 00000100:00100000:2.0:1788390375.886089:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390375.886101:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103214080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390375.886143:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390375.886195:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103214080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390375.886203:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788390375.886331:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390375.886367:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cdf80 x1875263103214080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390375.886390:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103214080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390375.887825:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390376.909115:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390377.935364:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390378.494010:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000001:00100000:3.0:1788390378.495208:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000001:02000400:1.0:1788390378.931434:0:10273:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1788390378.959436:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103214208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959504:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959544:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103214720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959567:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959590:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390378.959596:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103214592:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959645:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103214336:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959684:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103214848:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959719:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390378.959724:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103214464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390378.959773:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214208 00000100:00100000:1.0:1788390378.959781:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214208 00000100:00100000:1.0:1788390378.959835:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788390378.959843:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103214208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.959908:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103214208:12345-0@lo:400:kworker.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.959920:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788390378.959949:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214720 00000100:00100000:1.0:1788390378.959953:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214720 00000100:00100000:1.0:1788390378.959997:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214336 00000100:00100000:1.0:1788390378.960000:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214336 00000100:00100000:1.0:1788390378.960010:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214464 00000100:00100000:1.0:1788390378.960012:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214464 00000100:00100000:1.0:1788390378.960026:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390378.960032:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103214720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960528:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103214720:12345-0@lo:400:kworker.0 Request processed in 496us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.960534:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390378.960548:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390378.960554:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103214336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960583:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103214336:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.960589:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390378.960600:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788390378.960606:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960629:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103214464:12345-0@lo:400:kworker.0 Request processed in 24us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.960635:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788390378.960652:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214592 00000100:00100000:1.0:1788390378.960655:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214592 00000100:00100000:1.0:1788390378.960680:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214848 00000100:00100000:1.0:1788390378.960683:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214848 00000100:00100000:1.0:1788390378.960702:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390378.960713:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103214592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960743:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103214592:12345-0@lo:400:kworker.0 Request processed in 30us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.960748:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390378.960760:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390378.960765:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103214848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960791:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103214848:12345-0@lo:400:kworker.0 Request processed in 26us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390378.960802:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788390378.960831:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390378.960834:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390378.960836:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390378.960938:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103214464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.960954:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103214336:0@lo:400:kworker.0 00010000:00080000:1.0:1788390378.960986:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f79880 x1875263103214848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390378.960997:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103214848:0@lo:400:kworker.0 00010000:00080000:1.0:1788390378.961029:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc740a80 x1875263103214592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390378.961147:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103214592:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.961159:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103214208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390378.961170:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103214720:0@lo:400:kworker.0 00010000:00010000:3.0:1788390378.961934:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390379.469625:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390379.473578:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103214976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390379.473683:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390379.473948:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103214976 00000100:00100000:0.0:1788390379.473995:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103214976 00000100:00100000:0.0:1788390379.474064:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390379.474078:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103214976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390379.474128:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390379.474195:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103214976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390379.474204:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788390379.474316:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cdf80 x1875263103214976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390379.474342:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103214976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788390379.981395:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390380.044668:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000100:00100000:1.0:1788390380.661027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390380.661073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390380.661107:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390380.661154:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390380.661192:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746816 00000100:00100000:1.0:1788390380.661204:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746816 00000100:00100000:1.0:1788390380.661298:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746944 00000100:00100000:1.0:1788390380.661302:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746944 00000100:00100000:1.0:1788390380.661333:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788390380.661358:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093746816:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390380.661463:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093746816:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390380.661472:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788390380.661506:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390380.661514:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093746944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390380.661553:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093746944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390380.661559:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390380.661584:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747200 00000100:00100000:1.0:1788390380.661589:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747200 00000100:00100000:1.0:1788390380.661638:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788390380.661653:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093747200:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390380.661688:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093747200:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390380.661694:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00080000:1.0:1788390380.661711:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390380.661723:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390380.661893:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093746688 00000100:00100000:3.0:1788390380.661899:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093746688 00000100:00100000:3.0:1788390380.661998:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:3.0:1788390380.662007:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093746688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390380.662045:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093746688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390380.662053:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:3.0:1788390380.662125:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390380.662170:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747072 00000100:00100000:3.0:1788390380.662174:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747072 00000100:00080000:2.0:1788390380.662210:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390380.662219:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788390380.662227:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093747072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390380.662264:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093747072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 37us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390380.662271:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1788390381.005246:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103215104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390381.005348:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390381.005407:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390381.005478:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215104 00000100:00100000:2.0:1788390381.005490:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215104 00000100:00080000:1.0:1788390381.005564:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390381.005582:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390381.005596:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103215104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390381.005647:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390381.005710:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103215104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390381.005718:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788390381.005817:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cd880 x1875263103215104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.005841:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103215104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390382.030168:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390383.053885:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390384.077393:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390384.078258:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103215488:0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390384.078442:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788390384.078452:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103215360:0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390384.078515:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103215872:0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078545:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390384.078598:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215488 00000100:00100000:0.0:1788390384.078608:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215488 00000100:00100000:0.0:1788390384.078679:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215360 00000100:00100000:0.0:1788390384.078683:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215360 00000100:00100000:0.0:1788390384.078708:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390384.078719:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078779:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103215488:12345-0@lo:400:kworker.0 Request processed in 61us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.078787:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390384.078808:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788390384.078815:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103215360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078843:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103215360:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.078860:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788390384.078881:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215872 00000100:00100000:0.0:1788390384.078885:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215872 00000100:00100000:0.0:1788390384.078916:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390384.078923:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103215872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.078955:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103215872:12345-0@lo:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.078988:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788390384.079005:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390384.079010:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390384.079049:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103215360:0@lo:400:kworker.0 00010000:00080000:0.0:1788390384.079075:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f7c380 x1875263103215872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390384.079086:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103215872:0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.079095:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103215488:0@lo:400:kworker.0 00000100:00100000:3.0:1788390384.080276:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103215232:0@lo:400:kworker.0 00000100:00100000:3.0:1788390384.080348:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390384.080405:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103215744:0@lo:400:kworker.0 00000100:00100000:3.0:1788390384.080450:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390384.080479:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390384.080486:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103215616:0@lo:400:kworker.0 00000100:00100000:3.0:1788390384.080512:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390384.080556:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215616 00000100:00100000:3.0:1788390384.080564:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215616 00000100:00100000:1.0:1788390384.080606:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215232 00000100:00100000:1.0:1788390384.080613:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215232 00000100:00100000:3.0:1788390384.080631:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390384.080643:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103215616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390384.080698:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103215616:12345-0@lo:400:kworker.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390384.080705:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788390384.080748:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d691833480 x1875263103215616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390384.080763:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103215616:0@lo:400:kworker.0 00000100:00100000:1.0:1788390384.080777:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788390384.080790:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390384.080857:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103215232:12345-0@lo:400:kworker.0 Request processed in 61us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390384.080874:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788390384.080908:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103215232:0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.081089:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103215744 00000100:00100000:0.0:1788390384.081094:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103215744 00000100:00100000:0.0:1788390384.081424:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390384.081435:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103215744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390384.081489:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103215744:12345-0@lo:400:kworker.0 Request processed in 56us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.081496:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788390384.085485:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390384.085497:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390384.086242:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103215744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390384.595052:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390384.595082:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103216000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390384.595174:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390384.595250:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216000 00000100:00100000:1.0:1788390384.595259:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216000 00000100:00100000:1.0:1788390384.595314:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390384.595324:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103216000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390384.595369:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390384.595419:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103216000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390384.595428:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788390384.595475:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f78e00 x1875263103216000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390384.595505:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103216000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788390385.101256:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390385.781981:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390385.782023:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390385.782060:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390385.782080:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747712 00000100:00100000:2.0:1788390385.782092:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747712 00000100:00100000:0.0:1788390385.782093:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390385.782127:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390385.782160:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747328 00000100:00100000:0.0:1788390385.782165:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747328 00000100:00100000:2.0:1788390385.782191:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747840 00000100:00100000:2.0:1788390385.782197:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747840 00000100:00100000:0.0:1788390385.782207:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:0.0:1788390385.782222:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093747328:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390385.782234:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:2.0:1788390385.782252:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093747712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390385.782312:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093747328:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390385.782315:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093747712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390385.782329:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788390385.782330:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:2.0:1788390385.782356:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1788390385.782361:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747456 00000100:00100000:2.0:1788390385.782368:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093747840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390385.782369:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747456 00000100:00100000:0.0:1788390385.782390:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747584 00000100:00100000:0.0:1788390385.782395:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747584 00000100:00100000:2.0:1788390385.782401:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093747840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390385.782407:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1788390385.782422:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00080000:2.0:1788390385.782428:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390385.782435:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390385.782435:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093747456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788390385.782440:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390385.782440:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1788390385.782452:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093747584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390385.782481:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093747456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390385.782489:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1788390385.782494:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093747584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390385.782504:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788390386.125840:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103216128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390386.126132:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390386.126152:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390386.126511:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216128 00000100:00100000:0.0:1788390386.126523:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216128 00000100:00100000:0.0:1788390386.126646:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390386.126660:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103216128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390386.126705:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390386.126776:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103216128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390386.126785:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788390386.126857:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cca80 x1875263103216128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390386.126888:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103216128:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390386.127080:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390387.149050:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390388.173225:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390388.445013:0:10974:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788390389.198292:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103216256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198386:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198441:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103216768:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198470:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198497:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390389.198503:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103216640:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198531:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198563:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103216384:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198605:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103216896:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198626:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198645:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390389.198650:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103216512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390389.198738:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216256 00000100:00100000:1.0:1788390389.198748:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216256 00000100:00100000:1.0:1788390389.198814:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788390389.198826:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.198885:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103216256:12345-0@lo:400:kworker.0 Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390389.198892:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788390389.198928:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216768 00000100:00100000:1.0:1788390389.198933:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216768 00000100:00100000:1.0:1788390389.198992:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216384 00000100:00100000:1.0:1788390389.198996:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216384 00000100:00100000:1.0:1788390389.199007:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216512 00000100:00100000:1.0:1788390389.199009:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216512 00000100:00100000:1.0:1788390389.199026:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390389.199032:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103216768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199068:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103216768:12345-0@lo:400:kworker.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390389.199073:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390389.199085:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390389.199091:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103216384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199123:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103216384:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390389.199129:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390389.199141:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390389.199146:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199172:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103216512:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390389.199186:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390389.199245:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103216512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199256:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103216384:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199286:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103216256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390389.199297:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103216768:0@lo:400:kworker.0 00000100:00100000:2.0:1788390389.199423:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216640 00000100:00100000:2.0:1788390389.199426:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216640 00000100:00100000:2.0:1788390389.199456:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103216896 00000100:00100000:2.0:1788390389.199458:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103216896 00000100:00100000:2.0:1788390389.199475:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390389.199481:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103216640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390389.199511:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103216640:12345-0@lo:400:kworker.0 Request processed in 31us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390389.199515:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390389.199524:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390389.199527:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390389.199546:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103216896:12345-0@lo:400:kworker.0 Request processed in 19us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390389.199561:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788390389.199582:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390389.199587:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390389.199589:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390389.199612:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f7bb80 x1875263103216896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390389.199622:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103216896:0@lo:400:kworker.0 00010000:00080000:2.0:1788390389.199639:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f79500 x1875263103216640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390389.199645:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103216640:0@lo:400:kworker.0 00010000:00010000:0.0:1788390389.199913:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390389.709329:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103217024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390389.709686:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390389.712948:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217024 00000100:00100000:0.0:1788390389.712983:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217024 00000100:00100000:0.0:1788390389.713059:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390389.713072:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103217024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390389.713125:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390389.713233:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103217024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390389.713242:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788390389.713462:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f79500 x1875263103217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390389.713492:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103217024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788390390.221523:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390390.283398:0:11124:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccfbdaa10 20000000:00000080:3.0:1788390390.283420:0:11124:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d5867ec000 uarg=0000000000000000 20000000:01000000:3.0:1788390390.283478:0:11124:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788390390.283485:0:11124:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788390390.283491:0:11124:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788390390.284217:0:11125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788390390.284390:0:11124:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788390390.288398:0:11124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788390390.288440:0:11124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288467:0:11124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288476:0:11124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288482:0:11124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288489:0:11124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288496:0:11124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288503:0:11124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288560:0:11124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288579:0:11124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 12 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390390.288597:0:11124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217152:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390390.288810:0:11124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288817:0:11124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 18 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390390.288825:0:11124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217280:0@lo:104: 00000100:00100000:0.0:1788390390.288868:0:11124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.288910:0:11124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288916:0:11124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 18 pid: 5801 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390390.288921:0:11124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217408:0@lo:104: 00000100:00100000:0.0:1788390390.288934:0:11124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.288950:0:11124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.288955:0:11124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 18 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390390.288982:0:11124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217536:0@lo:104: 00000100:00100000:0.0:1788390390.288997:0:11124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.289010:0:11124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.289015:0:11124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 12 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390390.289030:0:11124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217664:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390390.289048:0:11124:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390390.289386:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217280 00000100:00100000:1.0:1788390390.289395:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217280 00000100:00100000:1.0:1788390390.289438:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217408 00000100:00100000:1.0:1788390390.289440:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217408 00000100:00100000:1.0:1788390390.289445:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217536 00000100:00100000:1.0:1788390390.289447:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217536 00000100:00100000:1.0:1788390390.289456:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390390.289464:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:11124:x1875263103217280:12345-0@lo:104: 00010000:00010000:1.0:1788390390.289475:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.289530:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390390.289536:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+5:11124:x1875263103217280:12345-0@lo:104: Request processed in 73us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390390.289543:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390390.289561:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390390.289567:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11124:x1875263103217408:12345-0@lo:104: 00010000:00010000:1.0:1788390390.289575:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.289608:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788390390.289613:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11124:x1875263103217408:12345-0@lo:104: Request processed in 47us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390390.289619:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390390.289631:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390390.289637:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:11124:x1875263103217536:12345-0@lo:104: 00010000:00010000:1.0:1788390390.289644:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.289669:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788390390.289674:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:11124:x1875263103217536:12345-0@lo:104: Request processed in 38us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390390.289679:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788390390.290568:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788390390.290577:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290587:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390390.290593:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290603:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390390.290612:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390390.290619:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390390.290667:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290674:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390390.290709:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290717:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd31d63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d6a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290735:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788390390.290738:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103217792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390390.290740:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290758:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390390.290761:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290769:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390390.290776:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390390.290782:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390390.290822:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.290828:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.290835:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390390.290843:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290850:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31d55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290864:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390390.290868:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.290875:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788390390.290875:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390390.290881:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.290883:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103217920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390390.290908:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.290908:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390390.290919:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390390.290926:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390390.290941:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.290947:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390390.290995:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.291002:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103218048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390390.291004:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd31d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31d4e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390390.291025:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390390.291029:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390390.291029:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390390.291033:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390390.291045:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390390.291093:0:11124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217280:0@lo:104: 00000100:00100000:0.0:1788390390.291104:0:11124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217408:0@lo:104: 00000100:00100000:0.0:1788390390.291113:0:11124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217536:0@lo:104: 00000100:00100000:3.0:1788390390.291254:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217792 00000100:00100000:3.0:1788390390.291260:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217792 00000100:00100000:1.0:1788390390.291267:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103217920 00000100:00100000:1.0:1788390390.291274:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103217920 00010000:00010000:3.0:1788390390.291297:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 20 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.291298:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 20 pid: 5801 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.291338:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218048 00000100:00100000:3.0:1788390390.291342:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390390.291349:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218048 00000100:00100000:3.0:1788390390.291353:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+20:3288:x1875263103217920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390390.291365:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 21 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291369:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390390.291377:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 21 pid: 5801 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.291379:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788390390.291388:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788390390.291393:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 21 pid: 5801 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291409:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31d5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31d55 expref: 21 pid: 5801 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291425:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390390.291465:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+20:3288:x1875263103217920:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390390.291474:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390390.291486:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103217920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390390.291492:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390390.291499:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103217792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390390.291507:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390390.291511:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 19 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291525:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 19 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291535:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6c173a600/0x9aafc5f04cd31d6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31d63 expref: 19 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291545:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390390.291575:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3288:x1875263103217792:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390390.291581:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103217792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390390.291586:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390390.291635:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390390.291641:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3286:x1875263103218048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390390.291648:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390390.291653:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 17 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291661:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 17 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291671:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31d4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31d47 expref: 17 pid: 5799 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.291680:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390390.291712:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103218048:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390390.291719:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390390.291741:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103218048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390390.301476:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390390.301530:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093747968 00000100:00100000:3.0:1788390390.301543:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093747968 00000100:00100000:0.0:1788390390.301577:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390390.301613:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 13 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.301644:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748096 00000100:00100000:1.0:1788390390.301650:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748096 00010000:00010000:1.0:1788390390.301672:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 14 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390390.301764:0:11124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217152:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390390.301777:0:11124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11124:1875263103217664:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390390.301831:0:11124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390390.302241:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788390390.302255:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+14:2357:x1875263093747968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390390.302274:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390390.302282:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 14 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.302296:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 14 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390390.302319:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31d7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea3e expref: 14 pid: 5801 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390390.302324:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1788390390.302337:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2357:x1875263093748096:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390390.302345:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390390.302349:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390390.302356:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 13 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302368:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 13 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302381:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd31d40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea06 expref: 13 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302400:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390390.302412:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:2357:x1875263093747968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 159us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390390.302429:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00010000:00010000:1.0:1788390390.302431:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302449:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302457:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302466:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302478:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302486:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390390.302491:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302501:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302516:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390390.302525:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390390.302548:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2357:x1875263093748096:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 215us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390390.302555:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00010000:00010000:2.0:1788390390.304897:0:11124:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390390.304917:0:11124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390390.304925:0:11124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031200/0x9aafc5f04cd31d9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390390.902814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390390.902953:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748352 00000100:00100000:3.0:1788390390.902997:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748352 00000100:00100000:3.0:1788390390.903074:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788390390.903086:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093748352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390390.903356:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093748352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 271us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390390.903365:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00080000:2.0:1788390390.903512:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390390.904367:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390390.904411:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390390.904464:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390390.904491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390390.904513:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748480 00000100:00100000:0.0:1788390390.904519:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748480 00000100:00100000:0.0:1788390390.904562:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1788390390.904571:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093748480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390390.904614:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093748480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390390.904620:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788390390.904780:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748224 00000100:00100000:2.0:1788390390.904798:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748224 00000100:00100000:2.0:1788390390.904836:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1788390390.904843:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2357:x1875263093748224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390390.904870:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2357:x1875263093748224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390390.904878:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1788390390.904909:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748736 00000100:00100000:2.0:1788390390.904912:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748736 00000100:00100000:2.0:1788390390.904938:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748608 00000100:00100000:2.0:1788390390.904941:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748608 00000100:00100000:2.0:1788390390.904997:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788390390.905005:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093748736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390390.905033:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093748736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390390.905039:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788390390.905050:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1788390390.905057:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68529f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093748608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390390.905090:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68529f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093748608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390390.905096:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00080000:2.0:1788390390.906105:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390390.906110:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390390.906112:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390391.245174:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390391.245352:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390391.245527:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390391.245597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.245770:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218176 00000100:00100000:2.0:1788390391.245778:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218176 00000100:00100000:2.0:1788390391.245873:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390391.245881:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103218176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390391.245922:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390391.245995:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103218176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.246002:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788390391.246065:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390391.246186:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a6cf100 x1875263103218176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.246200:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390391.925081:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390391.925145:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748864 00000100:00100000:0.0:1788390391.925157:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748864 00000100:00100000:0.0:1788390391.925219:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:0.0:1788390391.925230:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:5592:x1875263093748864:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390391.925248:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390391.925269:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea68 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.925298:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.925310:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.925320:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680030a00, rc 0) 00000100:00100000:0.0:1788390391.925386:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093748864:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 157us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.925393:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:3.0:1788390391.930594:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390391.930708:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093748992 00000100:00100000:0.0:1788390391.930727:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093748992 00000100:00100000:0.0:1788390391.930800:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:0.0:1788390391.930810:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093748992:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390391.931274:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093748992:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 464us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.931280:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:3.0:1788390391.932737:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390391.932817:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749120 00000100:00100000:0.0:1788390391.932822:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749120 00000100:00100000:0.0:1788390391.932879:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:0.0:1788390391.932885:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093749120:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390391.933056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093749120:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 171us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.933062:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:3.0:1788390391.936507:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390391.937577:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749248 00000100:00100000:0.0:1788390391.937590:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749248 00000100:00100000:0.0:1788390391.937655:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1788390391.937666:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093749248:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390391.937691:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390391.937711:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea6f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.937738:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.937750:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390391.937772:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d680031000, rc 0) 00000100:00100000:0.0:1788390391.937825:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093749248:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.937830:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:3.0:1788390391.946065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390391.946397:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749376 00000100:00100000:2.0:1788390391.946408:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749376 00000100:00100000:2.0:1788390391.946469:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:2.0:1788390391.946481:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093749376:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390391.946902:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093749376:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 421us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.946911:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1788390391.950392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390391.950499:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749504 00000100:00100000:1.0:1788390391.950511:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749504 00000100:00100000:1.0:1788390391.950611:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:1.0:1788390391.950622:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093749504:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390391.950859:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093749504:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 236us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390391.950868:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 10000000:01000000:0.0:1788390392.077031:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390392.077041:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a6b1a000 from 7 10000000:01000000:0.0:1788390392.077047:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390392.077108:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390392.077122:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390392.077137:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390392.077171:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390392.077275:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390392.077343:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.077487:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218304 00000100:00100000:3.0:1788390392.077497:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218304 00000100:00100000:3.0:1788390392.077561:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788390392.077573:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103218304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390392.077588:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390392.077603:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31db0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.077632:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.077644:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.077722:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390392.077764:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.077772:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788390392.077886:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390392.077903:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390392.077914:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390392.078010:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390392.078036:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390392.078056:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.078315:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218432 00000100:00100000:3.0:1788390392.078320:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218432 00000100:00100000:3.0:1788390392.078353:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788390392.078361:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.078666:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.078683:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788390392.078686:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390392.078722:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390392.078763:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390392.078794:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.078909:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218560 00000100:00100000:3.0:1788390392.078913:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218560 00000100:00100000:3.0:1788390392.078936:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788390392.078947:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.079150:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.079157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788390392.079251:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788390392.080321:0:11266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788390392.080580:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788390392.080614:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390392.080624:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.080633:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390392.080641:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390392.080643:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69fc01000 from 7 10000000:01000000:1.0:1788390392.080645:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390392.080684:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.080690:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.080698:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390392.080713:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.080761:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390392.080803:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.080828:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218688 00000100:00100000:3.0:1788390392.080835:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218688 00000100:00100000:3.0:1788390392.080882:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788390392.080892:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103218688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390392.080905:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390392.080920:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31dbe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.080945:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.080953:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.080982:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390392.081016:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103218688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.081023:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788390392.081051:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390392.081065:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.081073:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390392.081121:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.081151:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390392.081216:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.081311:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218816 00000100:00100000:3.0:1788390392.081321:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218816 00000100:00100000:3.0:1788390392.081383:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788390392.081389:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103218816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.081638:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103218816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.081645:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788390392.081716:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.081750:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.081797:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390392.081814:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390392.081826:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103218944 00000100:00100000:1.0:1788390392.081829:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103218944 00000100:00100000:1.0:1788390392.081849:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788390392.081854:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103218944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.082230:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103218944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 374us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390392.082249:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788390392.082288:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103218944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788390392.083186:0:11267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788390392.083327:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788390392.083345:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390392.083355:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083366:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390392.083378:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390392.083381:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a0d90000 from 7 10000000:01000000:1.0:1788390392.083384:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390392.083419:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083429:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083438:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390392.083456:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.083502:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390392.083536:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390392.083557:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219072 00000100:00100000:1.0:1788390392.083563:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219072 00000100:00100000:1.0:1788390392.083596:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788390392.083604:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103219072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390392.083616:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390392.083630:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31dcc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083799:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083810:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.083820:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173a400, rc 0) 00000100:00100000:1.0:1788390392.083903:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103219072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390392.083910:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788390392.084115:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390392.084131:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390392.084140:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390392.084201:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.084229:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390392.084321:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.084335:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219200 00000100:00100000:3.0:1788390392.084339:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219200 00000100:00100000:3.0:1788390392.084365:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788390392.084372:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103219200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.084790:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103219200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.084797:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788390392.084857:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.084884:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390392.084921:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390392.084992:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390392.085034:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219328 00000100:00100000:3.0:1788390392.085038:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219328 00000100:00100000:3.0:1788390392.085092:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788390392.085100:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103219328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390392.085265:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103219328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390392.085272:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788390392.085398:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103219328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788390392.086584:0:11268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788390392.086951:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788390392.087094:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390392.087106:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390392.087119:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390392.273398:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788390392.456479:0:11322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788390393.293191:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390394.317561:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390394.318154:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103219456:0@lo:400:kworker.0 00000100:00100000:0.0:1788390394.318252:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103219712:0@lo:400:kworker.0 00000100:00100000:3.0:1788390394.318260:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390394.318310:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219456 00000100:00100000:0.0:1788390394.318315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390394.318326:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219456 00000100:00100000:3.0:1788390394.318353:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103219968:0@lo:400:kworker.0 00000100:00100000:2.0:1788390394.318354:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103219584:0@lo:400:kworker.0 00000100:00100000:0.0:1788390394.318358:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390394.318371:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103219840:0@lo:400:kworker.0 00000100:00100000:1.0:1788390394.318387:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788390394.318394:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390394.318403:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390394.318417:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390394.318469:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219840 00000100:00100000:0.0:1788390394.318474:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219840 00000100:00100000:3.0:1788390394.318476:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219712 00000100:00100000:3.0:1788390394.318483:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219712 00000100:00100000:2.0:1788390394.318486:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390394.318486:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103219456:12345-0@lo:400:kworker.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.318496:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788390394.318525:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219968 00000100:00100000:2.0:1788390394.318528:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103220096:0@lo:400:kworker.0 00000100:00100000:3.0:1788390394.318530:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219968 00000100:00100000:0.0:1788390394.318544:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390394.318557:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103219584 00000100:00100000:0.0:1788390394.318558:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103219840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390394.318562:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103219584 00000100:00100000:2.0:1788390394.318569:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390394.318589:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390394.318598:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390394.318602:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103219712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390394.318612:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103219968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390394.318617:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220096 00000100:00100000:0.0:1788390394.318619:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103219840:12345-0@lo:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.318623:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220096 00000100:00100000:0.0:1788390394.318631:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390394.318657:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103219968:12345-0@lo:400:kworker.0 Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.318669:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390394.318670:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103219712:12345-0@lo:400:kworker.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.318671:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390394.318683:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390394.318685:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103220096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390394.318700:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788390394.318710:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103219584:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788390394.318731:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390394.318737:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103220096:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00080000:3.0:1788390394.318738:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390394.318747:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390394.318747:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788390394.318752:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103219584:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.318771:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788390394.318810:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103219584:0@lo:400:kworker.0 00010000:00080000:0.0:1788390394.318810:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f7b800 x1875263103219840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390394.318828:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103219840:0@lo:400:kworker.0 00010000:00080000:2.0:1788390394.318831:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fe69180 x1875263103220096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390394.318844:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103220096:0@lo:400:kworker.0 00000100:00100000:3.0:1788390394.318940:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103219456:0@lo:400:kworker.0 00000100:00100000:1.0:1788390394.319317:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103219712:0@lo:400:kworker.0 00000100:00100000:3.0:1788390394.319537:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103219968:0@lo:400:kworker.0 00000001:02000400:2.0:1788390394.647197:0:11421:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:06:34 (1788390394) === 00000100:00100000:3.0:1788390394.759708:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390394.759813:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749632 00000100:00100000:2.0:1788390394.759832:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749632 00000100:00080000:0.0:1788390394.760015:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390394.760025:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788390394.760040:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:9692:x1875263093749632:12345-192.168.202.1@tcp:700:mkdir.0 00000100:00100000:2.0:1788390394.760159:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:9692:x1875263093749632:12345-192.168.202.1@tcp:700:mkdir.0 Request processed in 123us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.760168:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390394.761622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390394.768860:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093749888 00000100:00100000:1.0:1788390394.768883:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093749888 00000100:00100000:1.0:1788390394.768992:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390394.769007:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:9692:x1875263093749888:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:1.0:1788390394.769089:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390394.771230:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d680030600/0x9aafc5f04cd31cbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f1 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.771268:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23400) 00010000:00010000:1.0:1788390394.771310:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390394.771860:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.771893:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.771906:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.773671:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.773694:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.773708:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390394.777782:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788390394.777801:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777813:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777821:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777827:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390394.777833:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777842:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777872:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390394.777875:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390394.777880:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.777887:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31dda lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390394.777906:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cef9a60 reply state 0000000016f1a6ac transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390394.777915:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390394.778434:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9692:x1875263093749888:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 9426us (16815us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788390394.778459:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:0.0:1788390394.786095:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786110:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786157:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786162:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390394.786166:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786172:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786186:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d684d23d00) 00010000:00010000:0.0:1788390394.786199:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390394.786202:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.786206:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd31de1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390394.792714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.794201:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750016 00000100:00100000:3.0:1788390394.794219:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750016 00000100:00100000:3.0:1788390394.794308:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390394.794322:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:9693:x1875263093750016:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:3.0:1788390394.794350:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390394.794383:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea76 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.794474:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.794490:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.794504:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390394.794551:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390394.794556:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390394.794601:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.795768:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea76 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.795801:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea76 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.795813:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:3.0:1788390394.795816:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390394.795821:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390394.795920:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9693:x1875263093750016:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 1599us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390394.795937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390394.801146:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390394.801259:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750272 00000100:00100000:2.0:1788390394.801271:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750272 00000100:00100000:2.0:1788390394.801389:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390394.801405:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9693:x1875263093750272:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:2.0:1788390394.801493:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390394.801529:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31def lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea76 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.801562:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:2.0:1788390394.801580:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390394.801618:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.801648:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.801661:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390394.802116:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004edafdf8 reply state 00000000c1ac189d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390394.802127:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788390394.802135:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788390394.802242:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:9693:x1875263093750272:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 842us (1107us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788390394.802251:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00010000:00010000:3.0:1788390394.807316:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807342:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807351:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807360:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390394.807366:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807375:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807399:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390394.807403:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390394.807409:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.807417:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31df6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390394.816533:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390394.816625:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750400 00000100:00100000:2.0:1788390394.816710:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750400 00000100:00100000:2.0:1788390394.816798:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788390394.816811:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9694:x1875263093750400:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788390394.816844:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390394.816876:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea7d expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817021:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817039:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817053:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390394.817100:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390394.817105:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390394.817155:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817188:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea7d expref: 9 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817207:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea7d expref: 8 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.817216:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:2.0:1788390394.817219:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390394.817223:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:2.0:1788390394.817297:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:9694:x1875263093750400:12345-192.168.202.1@tcp:101:chown.0 Request processed in 488us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.817304:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788390394.818606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.818741:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750528 00000100:00100000:3.0:1788390394.818761:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750528 00000100:00100000:3.0:1788390394.818817:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390394.818827:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:9694:x1875263093750528:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788390394.818846:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390394.818880:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.818943:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.818956:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819004:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819024:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819031:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819038:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819142:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819149:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819154:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390394.819180:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390394.819184:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390394.819200:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819215:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819220:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819225:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819229:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390394.819232:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819237:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819246:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:3.0:1788390394.819248:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390394.819250:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819254:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819263:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819266:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819270:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819277:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390394.819279:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819282:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819286:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d6a704c500) 00010000:00010000:3.0:1788390394.819287:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390394.819288:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819291:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea84 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819325:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea84 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.819329:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:3.0:1788390394.819330:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390394.819332:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390394.819371:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:9694:x1875263093750528:12345-192.168.202.1@tcp:101:chown.0 Request processed in 546us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390394.819376:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390394.821920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390394.822170:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750784 00000100:00100000:2.0:1788390394.822182:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750784 00000100:00100000:2.0:1788390394.822292:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390394.822304:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:9694:x1875263093750784:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:2.0:1788390394.822381:0:8163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390394.822417:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea84 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.822444:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:2.0:1788390394.822455:0:8163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390394.822487:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.822514:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.822525:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390394.833435:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103220224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390394.833535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390394.834057:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220224 00000100:00100000:1.0:1788390394.834068:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220224 00000100:00100000:1.0:1788390394.834136:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390394.834147:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103220224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390394.834191:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390394.834253:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103220224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.834261:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788390394.834311:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fe6b800 x1875263103220224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390394.834333:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103220224:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788390394.857361:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000004:00010000:0.0:1788390394.857388:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adcc60f6 reply state 000000000ea3d605 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390394.857403:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788390394.857404:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00200000:0.0:1788390394.857420:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788390394.857524:0:8163:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788390394.857553:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9694:x1875263093750784:12345-192.168.202.1@tcp:36:chown.0 Request processed in 35247us (35641us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788390394.857563:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:2.0:1788390394.857591:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.857607:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.857616:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.857622:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390394.857938:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.857948:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.858010:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641e000) 00010000:00010000:2.0:1788390394.858013:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788390394.858019:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.858026:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390394.875134:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.875250:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093750912 00000100:00100000:3.0:1788390394.875261:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093750912 00000100:00100000:3.0:1788390394.875331:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390394.875342:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:9695:x1875263093750912:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:3.0:1788390394.875368:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390394.875392:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea8b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390394.882138:0:5807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6691us 00010000:00010000:2.0:1788390394.902386:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.902418:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.902437:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.902455:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.902462:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.902469:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.903956:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905098:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905125:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390394.905175:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390394.905182:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390394.905238:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905255:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905264:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905272:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905279:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390394.905284:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905292:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905309:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:2.0:1788390394.905312:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390394.905318:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905325:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd31e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905351:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905357:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905362:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905367:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390394.905370:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905375:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905383:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d68641e000) 00010000:00010000:2.0:1788390394.905385:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390394.905388:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905393:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd31e3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905444:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea8b expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905461:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea8b expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.905480:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788390394.905482:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390394.905485:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:2.0:1788390394.905591:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9695:x1875263093750912:12345-192.168.202.1@tcp:101:touch.500 Request processed in 30248us (30464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.905601:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390394.912110:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.912206:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093751168 00000100:00100000:3.0:1788390394.912221:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093751168 00000100:00100000:3.0:1788390394.912280:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390394.912292:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:9695:x1875263093751168:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:3.0:1788390394.912313:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390394.912333:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea92 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.912859:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.912877:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.912889:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.912952:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.912995:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.913010:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390394.915570:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788390394.916757:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916777:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916789:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916828:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916836:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916843:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916848:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390394.916853:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916862:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916874:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788390394.916877:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390394.916889:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.916896:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390394.916910:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e8277df reply state 0000000086c18dfb transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390394.916919:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788390394.916954:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea92 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.917576:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea92 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.917586:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390394.917588:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390394.917591:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390394.917668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:9695:x1875263093751168:12345-192.168.202.1@tcp:101:touch.500 Request processed in 5378us (5572us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788390394.917676:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:2.0:1788390394.920899:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.920923:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.920933:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.920939:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390394.920946:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.920954:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.921013:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff95d6a704c500) 00010000:00010000:2.0:1788390394.921017:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390394.921025:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.921033:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31e58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390394.924922:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.925171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093751424 00000100:00100000:0.0:1788390394.925187:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093751424 00000100:00100000:0.0:1788390394.925372:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390394.925386:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:9695:x1875263093751424:12345-192.168.202.1@tcp:36:touch.500 00010000:00010000:0.0:1788390394.925472:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390394.925508:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea92 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.925538:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390394.925551:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390394.925627:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.925646:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.925657:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390394.925929:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b134855 reply state 0000000003e870d6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390394.925941:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390394.926157:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:9695:x1875263093751424:12345-192.168.202.1@tcp:36:touch.500 Request processed in 773us (1386us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788390394.926164:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:2.0:1788390394.927733:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927763:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927772:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927779:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390394.927785:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927793:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927812:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:2.0:1788390394.927815:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390394.927820:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.927826:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd31e6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390394.928254:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.930169:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093751552 00000100:00100000:0.0:1788390394.930200:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093751552 00000100:00100000:0.0:1788390394.930299:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390394.930313:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:9695:x1875263093751552:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:0.0:1788390394.930347:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390394.930377:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfea99 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.930455:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea99 expref: 10 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.930472:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea99 expref: 10 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.930523:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390394.930527:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390394.930531:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64faa00, rc 0) 00000100:00100000:0.0:1788390394.930630:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:9695:x1875263093751552:12345-192.168.202.1@tcp:101:touch.500 Request processed in 319us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.930638:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1788390394.933348:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.933463:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093751680 00000100:00100000:0.0:1788390394.933474:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093751680 00000100:00100000:0.0:1788390394.933524:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788390394.933536:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263093751680:12345-192.168.202.1@tcp:8:touch.500 00010000:00080000:0.0:1788390394.933577:0:6653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788390394.933627:0:6653:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd31e7b 00002000:00100000:0.0:1788390394.933642:0:6653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1107d28-9e62-443d-a57b-8cc59c78a09a/ffff95d6b6532800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390394.933678:0:6653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390394.936002:0:6653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390394.936065:0:6653:0:(import.c:65:import_set_state_nolock()) ffff95d6b6536000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390394.936187:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093751680:12345-192.168.202.1@tcp:8:touch.500 Request processed in 2639us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.936202:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390394.940248:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.942125:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093751808 00000100:00100000:0.0:1788390394.942147:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093751808 00000100:00080000:3.0:1788390394.942250:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390394.942262:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390394.942273:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:0:x1875263093751808:12345-192.168.202.1@tcp:2:touch.500 00000100:00100000:3.0:1788390394.972116:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:0:x1875263093751808:12345-192.168.202.1@tcp:2:touch.500 Request processed in 29825us (31866us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788390394.972133:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000001:00080000:3.0:1788390394.972501:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788390394.972516:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000100:00100000:1.0:1788390394.974362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.974485:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093752064 00000100:00100000:0.0:1788390394.974510:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093752064 00000100:00100000:0.0:1788390394.974577:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390394.974589:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:9695:x1875263093752064:12345-192.168.202.1@tcp:35:touch.500 00000100:00100000:2.0:1788390394.975575:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:9695:x1875263093752064:12345-192.168.202.1@tcp:35:touch.500 Request processed in 983us (1219us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788390394.975592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788390394.984266:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.984347:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093752192 00000100:00100000:3.0:1788390394.984376:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093752192 00000100:00100000:3.0:1788390394.984456:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390394.984471:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:9696:x1875263093752192:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788390394.984508:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390394.984539:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaa0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984630:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984669:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984683:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390394.984811:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390394.984816:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390394.984872:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984904:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaa0 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984932:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaa0 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390394.984943:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788390394.984946:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390394.984951:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390394.985092:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:9696:x1875263093752192:12345-192.168.202.1@tcp:101:rm.0 Request processed in 626us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390394.985098:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390394.987445:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390394.987560:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093752448 00000100:00100000:0.0:1788390394.987571:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093752448 00000100:00100000:0.0:1788390394.987880:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390394.987894:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:9696:x1875263093752448:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1788390394.987921:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390394.987944:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd31e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaa7 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390394.988197:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390394.988387:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd31e90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaa7 expref: 14 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.988401:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:0.0:1788390394.988403:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390394.988407:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd31e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaa7 expref: 14 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390394.988418:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:0.0:1788390394.988482:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:9696:x1875263093752448:12345-192.168.202.1@tcp:101:rm.0 Request processed in 593us (1048us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788390394.988487:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788390394.994286:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390394.994423:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093752576 00000100:00100000:3.0:1788390394.994435:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093752576 00000100:00100000:3.0:1788390394.994493:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390394.994503:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:9696:x1875263093752576:12345-192.168.202.1@tcp:37:rm.0 00000100:00100000:3.0:1788390395.000222:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:9696:x1875263093752576:12345-192.168.202.1@tcp:37:rm.0 Request processed in 5702us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390395.000239:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788390395.005408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390395.005514:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093752832 00000100:00100000:2.0:1788390395.005541:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093752832 00000100:00100000:2.0:1788390395.005610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390395.005623:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:9696:x1875263093752832:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:2.0:1788390395.006103:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:9696:x1875263093752832:12345-192.168.202.1@tcp:35:rm.0 Request processed in 479us (704us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788390395.006114:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390395.008230:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390395.008328:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093753088 00000100:00100000:0.0:1788390395.008340:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093753088 00000100:00100000:0.0:1788390395.008430:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390395.008443:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:9696:x1875263093753088:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1788390395.008485:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390395.008510:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd31e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaae expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.008650:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd31ea5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.008673:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd31ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.008687:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd31ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390395.008701:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390395.008861:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd31e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaae expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.008884:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd31ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.008894:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:0.0:1788390395.008897:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390395.008901:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fac00, rc 0) 00000100:00100000:0.0:1788390395.009025:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753088:12345-192.168.202.1@tcp:101:rm.0 Request processed in 584us (802us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788390395.009032:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390395.011807:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390395.011940:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093753216 00000100:00100000:1.0:1788390395.011950:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093753216 00000100:00100000:1.0:1788390395.012106:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788390395.012115:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753216:12345-192.168.202.1@tcp:41:rm.0 00000004:00000024:1.0:1788390395.012182:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788390395.012257:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753216:12345-192.168.202.1@tcp:41:rm.0 Request processed in 144us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390395.012263:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788390395.015252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390395.015348:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093753344 00000100:00100000:3.0:1788390395.015360:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093753344 00000100:00100000:3.0:1788390395.015460:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788390395.015473:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753344:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788390395.015496:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390395.015519:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeab5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015587:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015601:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015615:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015633:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015659:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015666:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015797:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015804:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015809:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390395.015837:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788390395.015841:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390395.015858:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015868:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015874:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015879:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015884:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015895:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390395.015899:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015905:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015916:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788390395.015918:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390395.015921:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015926:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015940:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015944:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015947:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015951:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390395.015952:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.015955:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.016164:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390395.016166:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390395.016168:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.016172:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd31ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.016200:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeab5 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.016210:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeab5 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.016215:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390395.016216:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390395.016218:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:2.0:1788390395.016354:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:9696:x1875263093753344:12345-192.168.202.1@tcp:101:rm.0 Request processed in 883us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390395.016360:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390395.018523:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390395.018740:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093753600 00000100:00100000:0.0:1788390395.018764:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093753600 00000100:00100000:0.0:1788390395.018903:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390395.018914:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:9696:x1875263093753600:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:0.0:1788390395.019014:0:8163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788390395.019044:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd31ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeab5 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019062:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd31e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea99 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019072:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390395.019084:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd31e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaa0 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019089:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:0.0:1788390395.019092:0:8163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390395.019112:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019124:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019135:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019151:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019158:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019177:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019297:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019302:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.019307:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390395.020137:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788390395.020148:0:8163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 212127186207ns, next at 213127183793ns, rc = 0 00010000:00010000:0.0:1788390395.020203:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020211:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020218:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020223:0:8163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020228:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020232:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020261:0:8163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390395.020280:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020284:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020289:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020292:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390395.020296:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020301:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020308:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23100) 00010000:00010000:0.0:1788390395.020311:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788390395.020313:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020316:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd31edd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020329:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020333:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020336:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020344:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390395.020346:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020350:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020354:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:0.0:1788390395.020355:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390395.020357:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.020360:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd31ecf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390395.020366:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e1217fd reply state 00000000f9849e88 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390395.020372:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390395.020460:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753600:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1545us (1943us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788390395.020466:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00010000:00010000:3.0:1788390395.020545:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390395.020552:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.020556:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390395.020559:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.020564:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.020571:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95d684d23100) 00010000:00010000:3.0:1788390395.020577:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390395.020580:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.020583:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd31ee4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.020595:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390395.020596:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390395.020597:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390395.022688:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022708:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022717:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022723:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390395.022728:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022736:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022765:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff95d684d23700) 00010000:00010000:2.0:1788390395.022769:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390395.022774:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.022797:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd31ed6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390395.023585:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390395.023724:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093753856 00000100:00100000:3.0:1788390395.023739:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093753856 00000100:00100000:3.0:1788390395.023902:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390395.023915:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:9696:x1875263093753856:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:3.0:1788390395.024218:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093753856:12345-192.168.202.1@tcp:35:rm.0 Request processed in 304us (639us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788390395.024231:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390395.025658:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390395.025724:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754112 00000100:00100000:2.0:1788390395.025736:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754112 00000100:00100000:2.0:1788390395.025815:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1788390395.025827:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:9696:x1875263093754112:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788390395.025888:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788390395.025917:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd31ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaae expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.025935:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea8b expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.025945:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788390395.025955:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31e04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea7d expref: 14 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026087:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:2.0:1788390395.026094:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390395.026121:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026133:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026141:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026167:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026172:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026176:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026428:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026435:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.026441:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390395.027069:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788390395.027087:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027094:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027099:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027103:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdda00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390395.027107:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027120:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027129:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:2.0:1788390395.027131:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788390395.027133:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027137:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31ef9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027153:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027157:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027161:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027163:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390395.027165:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027168:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027171:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390395.027173:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390395.027174:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390395.027183:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31eeb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390395.027191:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014eba498 reply state 0000000093455dd4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390395.027198:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390395.027285:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:9696:x1875263093754112:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1458us (1634us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788390395.027294:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00010000:00010000:3.0:1788390395.028906:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.028922:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.028930:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.028937:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390395.028942:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.028950:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.033190:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95d68641e000) 00010000:00010000:3.0:1788390395.033195:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390395.033205:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390395.033214:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31ef2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390395.342568:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390396.027520:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390396.027561:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390396.027603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390396.027618:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754240 00000100:00100000:3.0:1788390396.027631:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754240 00000100:00100000:0.0:1788390396.027639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390396.027663:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754368 00000100:00100000:0.0:1788390396.027673:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754368 00000100:00100000:2.0:1788390396.027688:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754496 00000100:00100000:3.0:1788390396.027699:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:2.0:1788390396.027702:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754496 00000100:00100000:3.0:1788390396.027713:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093754240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390396.027718:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754624 00000100:00100000:0.0:1788390396.027721:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754624 00000100:00100000:2.0:1788390396.027768:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390396.027776:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1788390396.027782:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093754496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390396.027790:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:2358:x1875263093754368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390396.027813:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093754240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390396.027822:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:0.0:1788390396.027829:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:2358:x1875263093754368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390396.027834:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1788390396.027840:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093754496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390396.027850:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788390396.027851:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390396.027864:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093754624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:3.0:1788390396.027870:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390396.027876:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390396.027890:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093754624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390396.027908:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788390396.031101:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390396.031490:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390396.031564:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754752 00000100:00100000:3.0:1788390396.031576:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754752 00000100:00100000:3.0:1788390396.031649:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093754880 00000100:00100000:3.0:1788390396.031653:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093754880 00000100:00100000:3.0:1788390396.031682:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390396.031694:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2355:x1875263093754752:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1788390396.031731:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31d8d 00000100:00080000:3.0:1788390396.031754:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6bc738000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390396.031805:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788390396.032223:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+2:2355:x1875263093754752:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 529us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390396.032239:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390396.032259:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390396.032268:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2355:x1875263093754880:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1788390396.032296:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31d94 00000100:00080000:3.0:1788390396.032303:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6a0f53800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390396.032326:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788390396.032554:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+2:2355:x1875263093754880:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 288us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390396.032561:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:3.0:1788390396.032585:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390396.032591:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788390396.032658:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390396.032662:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788390396.365161:0:6758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213472196563ns, next at 214472192593ns, rc = 0 00010000:00010000:2.0:1788390396.365268:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390396.365548:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103220352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390396.365650:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390396.365839:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220352 00000100:00100000:1.0:1788390396.365851:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220352 00000100:00100000:1.0:1788390396.365926:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390396.365936:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103220352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390396.365992:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390396.366046:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103220352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390396.366054:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788390396.366102:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f78700 x1875263103220352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390396.366122:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103220352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390396.366827:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390397.390362:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390397.518389:0:11571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:1.0:1788390398.102539:0:11619:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff19c94730 20000000:00000080:1.0:1788390398.102558:0:11619:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d585113400 uarg=0000000000000000 20000000:01000000:1.0:1788390398.102899:0:11619:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788390398.102906:0:11619:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788390398.102911:0:11619:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788390398.103825:0:11620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788390398.104170:0:11619:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788390398.111287:0:11619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788390398.111341:0:11619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788390398.111390:0:11619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788390398.111406:0:11619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788390398.111425:0:11619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111446:0:11619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111455:0:11619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111464:0:11619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111472:0:11619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111478:0:11619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111486:0:11619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111523:0:11619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111538:0:11619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.111551:0:11619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220480:0@lo:104: 00000100:00100000:1.0:1788390398.111620:0:11619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390398.111669:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220480 00000100:00100000:2.0:1788390398.111678:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220480 00010000:00010000:1.0:1788390398.111684:0:11619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111696:0:11619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.111705:0:11619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220608:0@lo:104: 00000100:00100000:1.0:1788390398.111744:0:11619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390398.111752:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220608 00000100:00100000:2.0:1788390398.111757:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220608 00010000:00010000:1.0:1788390398.111768:0:11619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111781:0:11619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390398.111781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390398.111806:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11619:x1875263103220480:12345-0@lo:104: 00010000:00010000:0.0:1788390398.111820:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.111860:0:11619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220736:0@lo:104: 00010000:00010000:0.0:1788390398.111889:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390398.111896:0:11619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390398.111901:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11619:x1875263103220480:12345-0@lo:104: Request processed in 98us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390398.111917:0:11619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.111929:0:11619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 12 pid: 5800 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.111939:0:11619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220864:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390398.112004:0:11619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.112014:0:11619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.112039:0:11619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220992:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390398.112060:0:11619:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc7116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390398.112079:0:11619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220480:0@lo:104: 00000100:00100000:2.0:1788390398.112736:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390398.112746:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390398.112751:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11619:x1875263103220608:12345-0@lo:104: 00010000:00010000:2.0:1788390398.112762:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390398.112776:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390398.112798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103220736 00000100:00100000:0.0:1788390398.112802:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103220736 00010000:00010000:2.0:1788390398.112817:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390398.112824:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11619:x1875263103220608:12345-0@lo:104: Request processed in 80us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390398.112830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390398.112843:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390398.112849:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+4:11619:x1875263103220736:12345-0@lo:104: 00010000:00010000:2.0:1788390398.112867:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390398.112869:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.112874:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.112885:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173bc00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390398.112890:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390398.112898:0:11619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220608:0@lo:104: 00010000:00010000:2.0:1788390398.112901:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.112912:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390398.112916:0:11619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220736:0@lo:104: 00000100:00100000:0.0:1788390398.112922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+3:11619:x1875263103220736:12345-0@lo:104: Request processed in 76us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390398.112929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:00010000:2.0:1788390398.112979:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390398.112986:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390398.112989:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390398.113019:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113026:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390398.113062:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113069:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6c173bc00/0x9aafc5f04cd31dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dd3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113082:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390398.113085:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113091:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680031c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390398.113094:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113102:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390398.113109:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390398.113115:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390398.113130:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113136:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390398.113142:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113149:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680031c00/0x9aafc5f04cd31db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31db7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.113159:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390398.113164:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390398.113167:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390398.113189:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103221248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390398.113220:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390398.113258:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390398.113264:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103221120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390398.113404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390398.113432:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221248 00000100:00100000:1.0:1788390398.113436:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221248 00010000:00010000:1.0:1788390398.113453:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 19 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.113470:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221120 00000100:00100000:1.0:1788390398.113473:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221120 00010000:00010000:1.0:1788390398.113481:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 20 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.113497:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390398.113503:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+20:3289:x1875263103221248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390398.113512:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390398.113517:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 20 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.113526:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 20 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.113550:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd31db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31db0 expref: 20 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.113561:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390398.113586:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103221248:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390398.113592:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390398.113606:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390398.113612:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3289:x1875263103221120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390398.113622:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788390398.114198:0:11619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220864:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390398.114262:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.114273:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.114331:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6c173a400/0x9aafc5f04cd31dd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31dcc expref: 18 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390398.114341:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390398.114365:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3289:x1875263103221120:12345-0@lo:103:ldlm_bl.0 Request processed in 753us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390398.114372:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788390398.114399:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390398.114409:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103221120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390398.114412:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173b800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390398.114418:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.114422:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390398.114422:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103221248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390398.114433:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390398.114442:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390398.114449:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390398.114473:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.114478:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390398.114503:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.114521:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6c173b800/0x9aafc5f04cd31dbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd31dc5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.114535:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390398.114536:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390398.114538:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390398.114546:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390398.114568:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103221376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390398.114612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390398.114695:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221376 00000100:00100000:3.0:1788390398.114700:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221376 00010000:00010000:2.0:1788390398.114709:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390398.114713:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390398.114781:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 17 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390398.114841:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390398.114852:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3287:x1875263103221376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390398.114863:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390398.114869:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 17 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.114879:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 17 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.114890:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd31dc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd31dbe expref: 17 pid: 5800 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.114899:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390398.114940:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3287:x1875263103221376:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390398.114946:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390398.114953:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103221376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390398.114994:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390398.115211:0:11619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11619:1875263103220992:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390398.115243:0:11619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390398.115890:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755008 00000100:00100000:2.0:1788390398.115895:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755008 00010000:00010000:2.0:1788390398.115914:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390398.115937:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788390398.115945:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093755008:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390398.115953:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390398.115991:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.116001:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.116013:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031000/0x9aafc5f04cd31da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea6f expref: 13 pid: 5800 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390398.116026:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390398.116062:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:2356:x1875263093755008:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 118us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390398.116069:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390398.118004:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390398.118044:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755136 00000100:00100000:0.0:1788390398.118053:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755136 00010000:00010000:0.0:1788390398.118092:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390398.118123:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390398.118140:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:2356:x1875263093755136:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390398.118153:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390398.118159:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118170:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118185:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030a00/0x9aafc5f04cd31da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea68 expref: 12 pid: 5799 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118218:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118226:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118242:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118250:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118258:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118265:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118271:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390398.118275:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118283:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118299:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390398.118309:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390398.118330:0:11619:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390398.118341:0:11619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390398.118348:0:11619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd31f00 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390398.118355:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2356:x1875263093755136:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 222us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390398.118369:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00010000:00010000:2.0:1788390398.413857:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788390398.949126:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000020:00000080:2.0:1788390398.949138:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6a0f52800/a1ff6842-4530-4584-9014-31d80c6aefa2 00000020:00000080:3.0:1788390398.949240:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a0f52800/a1ff6842-4530-4584-9014-31d80c6aefa2 for lustre-OST0001 00000020:00000080:3.0:1788390398.949311:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a0f53800 for lustre-OST0001 10000000:01000000:2.0:1788390399.181520:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390399.181596:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a6b1a000 from 7 10000000:01000000:2.0:1788390399.181601:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390399.181656:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.181667:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.181677:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390399.181721:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.181805:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.182471:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.185627:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221504 00000100:00100000:1.0:1788390399.185643:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221504 00000100:00100000:1.0:1788390399.185849:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788390399.185861:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:5803:x1875263103221504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390399.185880:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390399.185900:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63800/0x9aafc5f04cd31f0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31f07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.185929:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63800/0x9aafc5f04cd31f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f07 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.185941:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63800/0x9aafc5f04cd31f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f07 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.185951:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63800, rc 0) 00000100:00100000:1.0:1788390399.188373:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103221504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2504us (6557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.188386:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788390399.194268:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390399.194303:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.194317:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390399.194407:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.194479:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.194607:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.194768:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221632 00000100:00100000:3.0:1788390399.194775:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221632 00000100:00100000:3.0:1788390399.194835:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788390399.194844:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103221632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.195091:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103221632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.195097:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788390399.195402:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.195434:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.195487:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.195514:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.195753:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221760 00000100:00100000:1.0:1788390399.195758:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221760 00000100:00100000:1.0:1788390399.195826:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788390399.195835:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103221760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.196002:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103221760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.196010:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788390399.196064:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103221760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.197001:0:11635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11635:1875263103221888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390399.197060:0:11635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.197098:0:11635:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.197101:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103221888 00000100:00100000:1.0:1788390399.197106:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103221888 00000100:00100000:1.0:1788390399.197164:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788390399.197171:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:11635:x1875263103221888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.197309:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:11635:x1875263103221888:12345-0@lo:502:llog_process_th.0 Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.197315:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788390399.197347:0:11635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11635:1875263103221888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390399.197373:0:11635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390399.197382:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390399.197384:0:11635:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390399.197392:0:11635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6a6b1a000 00000020:00000080:2.0:1788390399.197395:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788390399.199493:0:11635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11635:1875263103222016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390399.199700:0:11635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.199827:0:11635:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.201061:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222016 00000100:00100000:1.0:1788390399.201069:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222016 00000100:00100000:1.0:1788390399.201110:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788390399.201117:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:11635:x1875263103222016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.201308:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:11635:x1875263103222016:12345-0@lo:502:llog_process_th.0 Request processed in 191us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.201314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788390399.202062:0:11635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11635:1875263103222016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390399.202099:0:11635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390399.202107:0:11635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390399.202109:0:11635:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788390399.202113:0:11635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788390399.202230:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788390399.202253:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390399.202263:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.202275:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390399.202285:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390399.202288:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69fc01000 from 7 10000000:01000000:2.0:1788390399.202291:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390399.202322:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.202331:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.202341:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390399.202363:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.202419:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.202471:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.202754:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222144 00000100:00100000:1.0:1788390399.202760:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222144 00000100:00100000:1.0:1788390399.202802:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788390399.202812:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:5803:x1875263103222144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390399.202823:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390399.202836:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd31f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31f15 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.202860:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd31f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f15 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.202871:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd31f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f15 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.202880:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62a00, rc 0) 00000100:00100000:1.0:1788390399.202925:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.202942:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788390399.203047:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390399.203060:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.203067:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390399.203105:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390399.203127:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390399.203150:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.203159:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222272 00000100:00100000:3.0:1788390399.203163:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222272 00000100:00100000:3.0:1788390399.203191:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788390399.203199:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.203480:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.203488:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788390399.204837:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390399.204881:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390399.204931:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390399.206638:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.208424:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222400 00000100:00100000:3.0:1788390399.208436:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222400 00000040:00080000:2.0:1788390399.209234:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788390399.209452:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788390399.209466:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.209704:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.209726:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788390399.210754:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.213548:0:11639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11639:1875263103222528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390399.213624:0:11639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.213695:0:11639:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.213734:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222528 00000100:00100000:3.0:1788390399.213740:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222528 00000100:00100000:3.0:1788390399.213811:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788390399.213821:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:11639:x1875263103222528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390399.214194:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:11639:x1875263103222528:12345-0@lo:502:llog_process_th.0 Request processed in 373us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.214202:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788390399.214340:0:11639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11639:1875263103222528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390399.214367:0:11639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390399.214376:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390399.214379:0:11639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390399.214385:0:11639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d69fc01000 00000020:00000080:2.0:1788390399.214388:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788390399.214490:0:11639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11639:1875263103222656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390399.214523:0:11639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.214552:0:11639:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.214588:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222656 00000100:00100000:1.0:1788390399.214593:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222656 00000100:00100000:1.0:1788390399.214630:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788390399.214638:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:11639:x1875263103222656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.214771:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:11639:x1875263103222656:12345-0@lo:502:llog_process_th.0 Request processed in 134us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.214778:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788390399.214847:0:11639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11639:1875263103222656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390399.214866:0:11639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390399.214870:0:11639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390399.214872:0:11639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788390399.214875:0:11639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788390399.215058:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788390399.215080:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390399.215090:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.215102:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390399.215113:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390399.215116:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6a0d90000 from 7 10000000:01000000:1.0:1788390399.215119:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390399.215144:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.215152:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.215162:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390399.215174:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.215207:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.215229:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390399.215270:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222784 00000100:00100000:2.0:1788390399.215274:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222784 00000100:00100000:2.0:1788390399.215303:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788390399.215310:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:5803:x1875263103222784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390399.215318:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390399.215328:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31f2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd31f23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.215349:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f23 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.215359:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd31f23 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390399.215378:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:2.0:1788390399.215403:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103222784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390399.215409:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788390399.215464:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390399.215476:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.215484:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390399.215524:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.215548:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.215566:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.215649:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103222912 00000100:00100000:3.0:1788390399.215653:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103222912 00000100:00100000:3.0:1788390399.215680:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788390399.215687:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103222912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.215906:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103222912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.215913:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788390399.216010:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103222912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.216035:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103223040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.216068:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.216088:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390399.216134:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223040 00000100:00100000:3.0:1788390399.216138:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223040 00000100:00100000:3.0:1788390399.216221:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788390399.216228:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103223040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.216343:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:5803:x1875263103223040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.216355:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788390399.219854:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:5803:1875263103223040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.220088:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11641:1875263103223168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.220159:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.220191:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223168 00000100:00100000:1.0:1788390399.220197:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223168 00000100:00100000:1.0:1788390399.220232:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788390399.220242:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:11641:x1875263103223168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.220441:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:11641:x1875263103223168:12345-0@lo:502:llog_process_th.0 Request processed in 200us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.220454:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788390399.220499:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.220511:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11641:1875263103223168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390399.220532:0:11641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390399.220541:0:11641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390399.220544:0:11641:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390399.220552:0:11641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6a0d90000 00000020:00000080:1.0:1788390399.220554:0:11641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390399.220627:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11641:1875263103223296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.220656:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.220673:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223296 00000100:00100000:1.0:1788390399.220676:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223296 00000100:00100000:1.0:1788390399.220691:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788390399.220696:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:11641:x1875263103223296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390399.220801:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:11641:x1875263103223296:12345-0@lo:502:llog_process_th.0 Request processed in 104us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.220808:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788390399.220832:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390399.220844:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:11641:1875263103223296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390399.220860:0:11641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390399.220864:0:11641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390399.220865:0:11641:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390399.220869:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788390399.220920:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788390399.220937:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390399.220946:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.220996:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.438400:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390399.440022:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103223808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.440169:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788390399.440175:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103223424:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440197:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.440213:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103223936:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440234:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.440264:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103223680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440287:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.440306:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390399.440311:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103223552:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440331:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390399.440357:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223936 00000100:00100000:1.0:1788390399.440364:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223936 00000100:00100000:1.0:1788390399.440419:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223680 00000100:00100000:1.0:1788390399.440422:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223680 00000100:00100000:1.0:1788390399.440446:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390399.440456:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440507:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103223936:12345-0@lo:400:kworker.0 Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.440514:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390399.440531:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788390399.440551:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.440583:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103223680:12345-0@lo:400:kworker.0 Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.440589:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788390399.440608:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390399.440612:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788390399.440645:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fc75880 x1875263103223680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390399.440659:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103223680:0@lo:400:kworker.0 00010000:00080000:1.0:1788390399.440687:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fc75f80 x1875263103223936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390399.440696:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103223936:0@lo:400:kworker.0 00000100:00100000:3.0:1788390399.440777:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223808 00000100:00100000:3.0:1788390399.440782:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223808 00000100:00100000:3.0:1788390399.440818:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223424 00000100:00100000:3.0:1788390399.440821:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223424 00000100:00100000:3.0:1788390399.440833:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103223552 00000100:00100000:3.0:1788390399.440836:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103223552 00000100:00100000:3.0:1788390399.440850:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788390399.440857:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390399.440894:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103223808:12345-0@lo:400:kworker.0 Request processed in 37us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.440900:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788390399.440912:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788390399.440918:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103223424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390399.440944:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103223424:12345-0@lo:400:kworker.0 Request processed in 26us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.440949:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788390399.440958:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788390399.441011:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103223552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390399.441042:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103223552:12345-0@lo:400:kworker.0 Request processed in 33us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.441047:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788390399.441261:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390399.441282:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103223552:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.441304:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103223424:0@lo:400:kworker.0 00000100:00100000:1.0:1788390399.441313:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103223808:0@lo:400:kworker.0 00000100:00100000:3.0:1788390399.860798:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390399.860891:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755264 00000100:00100000:1.0:1788390399.860902:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755264 00000100:00100000:1.0:1788390399.861007:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:1.0:1788390399.861018:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:5592:x1875263093755264:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390399.861037:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390399.861056:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd31f31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeabc expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.861104:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd31f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeabc expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.861116:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd31f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeabc expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.861126:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62c00, rc 0) 00000100:00100000:1.0:1788390399.861182:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755264:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 166us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.861188:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:1.0:1788390399.871416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390399.875099:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755392 00000100:00100000:3.0:1788390399.875117:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755392 00000100:00100000:3.0:1788390399.875252:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:3.0:1788390399.875264:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755392:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.875587:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755392:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 326us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.875596:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:3.0:1788390399.882285:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390399.882785:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755520 00000100:00100000:2.0:1788390399.882796:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755520 00000100:00100000:2.0:1788390399.882855:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:2.0:1788390399.882867:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755520:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390399.883126:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755520:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 261us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390399.883134:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1788390399.894019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390399.896826:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755648 00000100:00100000:3.0:1788390399.896841:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755648 00000100:00100000:3.0:1788390399.896911:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:3.0:1788390399.896921:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:9967:x1875263093755648:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390399.897907:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:9967:x1875263093755648:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 982us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.897918:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:3.0:1788390399.907642:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390399.907754:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755776 00000100:00100000:1.0:1788390399.907765:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755776 00000100:00100000:1.0:1788390399.907826:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:1.0:1788390399.907837:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:9967:x1875263093755776:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390399.908198:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:9967:x1875263093755776:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 362us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.908206:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:2.0:1788390399.912674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390399.914754:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093755904 00000100:00100000:3.0:1788390399.914769:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093755904 00000100:00100000:3.0:1788390399.914883:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:3.0:1788390399.914895:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:5592:x1875263093755904:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390399.914912:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390399.914931:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31f38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeac3 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390399.915001:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeac3 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390399.915014:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeac3 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390399.915022:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788390399.915106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093755904:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 213us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.915113:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:0.0:1788390399.924530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390399.924589:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756032 00000100:00100000:1.0:1788390399.924599:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756032 00000100:00100000:1.0:1788390399.924729:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:1.0:1788390399.924740:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093756032:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390399.925031:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093756032:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 292us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.925039:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:1.0:1788390399.929103:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390399.929175:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756160 00000100:00100000:3.0:1788390399.929184:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756160 00000100:00100000:3.0:1788390399.929241:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:3.0:1788390399.929251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093756160:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390399.929435:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:5592:x1875263093756160:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 185us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.929443:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:3.0:1788390399.934447:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390399.934553:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756288 00000100:00100000:1.0:1788390399.934569:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756288 00000100:00100000:1.0:1788390399.935233:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:1.0:1788390399.935246:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:9970:x1875263093756288:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390399.935451:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:9970:x1875263093756288:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 209us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.935456:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:0.0:1788390399.939120:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390399.939167:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756416 00000100:00100000:3.0:1788390399.939178:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756416 00000100:00100000:3.0:1788390399.939225:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:3.0:1788390399.939235:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:9970:x1875263093756416:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390399.939450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:9970:x1875263093756416:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 215us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.939458:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:3.0:1788390399.949271:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390399.949294:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103224064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390399.949358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390399.949423:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224064 00000100:00100000:3.0:1788390399.949430:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224064 00000100:00100000:3.0:1788390399.949472:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390399.949480:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103224064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390399.949511:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390399.949562:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103224064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.949568:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788390399.949605:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fc77100 x1875263103224064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390399.949636:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103224064:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788390399.982346:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000020:00000080:3.0:1788390399.982355:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6bc73a800/a1ff6842-4530-4584-9014-31d80c6aefa2 00000020:00000080:0.0:1788390399.982389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc73a800/a1ff6842-4530-4584-9014-31d80c6aefa2 for lustre-OST0000 00000020:00000080:0.0:1788390399.982527:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bc738000 for lustre-OST0000 00000001:00080000:0.0:1788390399.990712:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1788390399.990728:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788390399.991989:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103224192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788390399.992052:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390399.992114:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224192 00000100:00100000:0.0:1788390399.992120:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224192 00000100:00100000:0.0:1788390399.992160:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390399.992168:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103224192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788390399.992193:0:6650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788390399.992226:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a98abfb, atime: 0x6a98abfb, ctime: 0x6a98abfb, blocks: 0x1 00010000:00010000:0.0:1788390399.992233:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.992245:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=217s v=(0 0) 00010000:00010000:0.0:1788390399.992248:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390399.992253:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.992265:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.992272:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.992277:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390399.992304:0:6650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788390399.992414:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788390399.992425:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00010000:00010000:1.0:1788390399.993051:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390399.993060:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.993070:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390399.993075:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.993084:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.993105:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.993113:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd31f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390399.993520:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390399.993522:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390399.993529:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390399.993973:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103224192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1792us (1906us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788390399.993981:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1788390399.995740:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69fc77100/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788390399.995754:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103224192:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1788390400.274562:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788390400.464061:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390401.141135:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390401.141179:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390401.141213:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390401.141247:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390401.141369:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756672 00000100:00100000:1.0:1788390401.141384:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756544 00000100:00100000:0.0:1788390401.141391:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756672 00000100:00100000:1.0:1788390401.141399:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756544 00000100:00100000:0.0:1788390401.141479:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756928 00000100:00100000:0.0:1788390401.141485:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756928 00000100:00100000:1.0:1788390401.141493:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00100000:1.0:1788390401.141513:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2359:x1875263093756544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390401.141530:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788390401.141544:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093756672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390401.141633:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2359:x1875263093756544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 123us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390401.141645:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00080000:3.0:1788390401.141664:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390401.141722:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093756800 00000100:00100000:1.0:1788390401.141729:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093756800 00000100:00100000:2.0:1788390401.141789:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390401.141798:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788390401.141813:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093756928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390401.141815:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093756800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390401.145744:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093756672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 4189us (4605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390401.145759:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00080000:3.0:1788390401.146674:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390401.147129:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093756928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 5318us (5942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390401.147141:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390401.147161:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093756800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 5336us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390401.147181:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00010000:00010000:3.0:1788390401.486498:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390401.486530:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390401.486557:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103224320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390401.486628:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390401.486754:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224320 00000100:00100000:3.0:1788390401.486769:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224320 00000100:00100000:3.0:1788390401.486885:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390401.486901:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103224320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390401.486956:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390401.487100:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103224320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390401.487110:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788390401.487157:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103224320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390401.487393:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390402.509989:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390403.533266:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390404.557220:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390404.557501:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390404.557523:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103224448:0@lo:400:kworker.0 00000100:00100000:2.0:1788390404.557601:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390404.557651:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103224576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.557712:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390404.557734:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.557754:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390404.557771:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390404.557772:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103224832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.557779:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103224704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.557821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390404.557821:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390404.557851:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224576 00000100:00100000:3.0:1788390404.557858:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224576 00000100:00100000:2.0:1788390404.557861:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390404.557870:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.557901:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224704 00000100:00100000:3.0:1788390404.557905:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224704 00000100:00100000:2.0:1788390404.557909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390404.557936:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224960 00000100:00100000:3.0:1788390404.557940:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224960 00000100:00100000:2.0:1788390404.557953:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225088 00000100:00080000:1.0:1788390404.557955:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390404.557980:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225088 00000100:00100000:3.0:1788390404.557985:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390404.558000:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103224576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390404.558000:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390404.558017:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103224704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.558057:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103224576:12345-0@lo:400:kworker.0 Request processed in 62us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390404.558066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788390404.558072:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103224704:12345-0@lo:400:kworker.0 Request processed in 58us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390404.558080:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390404.558085:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224832 00000100:00100000:3.0:1788390404.558090:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390404.558091:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224832 00000100:00100000:3.0:1788390404.558101:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103224960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788390404.558108:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390404.558112:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390404.558125:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390404.558143:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103225088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.558145:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103224960:12345-0@lo:400:kworker.0 Request processed in 43us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390404.558157:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390404.558185:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103225088:12345-0@lo:400:kworker.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390404.558190:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390404.558198:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390404.558202:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103224704:0@lo:400:kworker.0 00000100:00100000:2.0:1788390404.558203:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103224832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.558224:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103224576:0@lo:400:kworker.0 00010000:00080000:3.0:1788390404.558253:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6a0f7f800 x1875263103225088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390404.558255:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103224832:12345-0@lo:400:kworker.0 Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390404.558271:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.558311:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390404.558321:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103224832:0@lo:400:kworker.0 00000100:00100000:2.0:1788390404.558392:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788390404.558607:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103224448 00000100:00100000:0.0:1788390404.558612:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103224448 00000100:00100000:0.0:1788390404.558645:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788390404.558652:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103224448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390404.558710:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103224448:12345-0@lo:400:kworker.0 Request processed in 58us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390404.558716:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788390404.558794:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103224448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390405.069899:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103225216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390405.069996:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390405.070041:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225216 00000100:00100000:2.0:1788390405.070049:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225216 00000100:00100000:2.0:1788390405.070100:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390405.070110:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103225216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390405.070145:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390405.070200:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103225216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390405.070207:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788390405.070257:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fe69180 x1875263103225216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390405.070276:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103225216:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788390405.114296:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1788390405.581547:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390406.261426:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390406.261478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390406.261587:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757184 00000100:00100000:1.0:1788390406.261595:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757440 00000100:00100000:2.0:1788390406.261604:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757184 00000100:00100000:1.0:1788390406.261604:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757440 00000100:00100000:1.0:1788390406.261716:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1788390406.261731:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093757440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390406.262059:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390406.262082:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093757184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390406.262114:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093757184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390406.262121:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788390406.262150:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093757440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 105us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390406.262163:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00080000:0.0:1788390406.262275:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390406.264158:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390406.264215:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390406.264356:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757056 00000100:00100000:1.0:1788390406.264370:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757056 00000100:00100000:1.0:1788390406.264440:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:1.0:1788390406.264452:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093757056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390406.264563:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093757056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390406.264572:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:2.0:1788390406.266105:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757312 00000100:00100000:2.0:1788390406.266121:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757312 00000100:00100000:2.0:1788390406.266294:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1788390406.266306:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093757312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390406.266408:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093757312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390406.266416:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00080000:0.0:1788390406.267888:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390406.605377:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103225344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390406.605391:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390406.605476:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390406.605530:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225344 00000100:00100000:3.0:1788390406.605540:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225344 00000100:00080000:1.0:1788390406.605613:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390406.605630:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390406.605651:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103225344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390406.605708:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390406.605777:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103225344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390406.605786:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390406.605831:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788390406.605840:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69fc77100, transno 4294967300 00000100:00100000:0.0:1788390406.605872:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103225344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390407.632175:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390408.654279:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390409.677292:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103225472:0@lo:400:kworker.0 00000100:00100000:1.0:1788390409.677351:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390409.677477:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225472 00000100:00100000:1.0:1788390409.677478:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390409.677486:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225472 00000100:00100000:1.0:1788390409.677488:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103225856:0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.677539:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788390409.677548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390409.677554:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103225472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390409.677565:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103225728:0@lo:400:kworker.0 00000100:00100000:1.0:1788390409.677603:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225856 00000100:00100000:1.0:1788390409.677608:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225856 00000100:00100000:0.0:1788390409.677632:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103225472:12345-0@lo:400:kworker.0 Request processed in 82us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390409.677640:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788390409.677662:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390409.677672:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103225856:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390409.677685:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390409.677713:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103225856:12345-0@lo:400:kworker.0 Request processed in 43us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390409.677715:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103225472:0@lo:400:kworker.0 00000100:00100000:1.0:1788390409.677725:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788390409.677761:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103225856:0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.678394:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788390409.678407:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390409.678468:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225728 00000100:00100000:1.0:1788390409.678473:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225728 00000100:00100000:1.0:1788390409.678511:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390409.678523:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103225728:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390409.678780:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390409.678800:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103225600:0@lo:400:kworker.0 00010000:00010000:2.0:1788390409.678865:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390409.679166:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103225728:0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.679352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390409.679379:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788390409.679393:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225600 00000100:00100000:0.0:1788390409.679407:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390409.679408:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225600 00000100:00100000:3.0:1788390409.679437:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788390409.679443:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103225600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.679466:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226112 00000100:00100000:0.0:1788390409.679471:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226112 00000100:00100000:3.0:1788390409.679478:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103225600:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390409.679484:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788390409.679510:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103225600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.679522:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390409.679533:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103226112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.679575:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103226112:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390409.679581:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788390409.679598:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390409.679750:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390409.680083:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103225984 00000100:00100000:0.0:1788390409.680088:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103225984 00000100:00100000:0.0:1788390409.680126:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788390409.680132:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103225984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390409.680171:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103225984:12345-0@lo:400:kworker.0 Request processed in 38us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390409.680177:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788390409.680202:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d682e97800 x1875263103226112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390409.680212:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788390409.680215:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103226112:0@lo:400:kworker.0 00000100:00080000:2.0:1788390409.680280:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390409.680384:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103225728:12345-0@lo:400:kworker.0 Request processed in 1861us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.680391:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390410.189901:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390410.189926:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103226240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390410.190013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390410.190292:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226240 00000100:00100000:3.0:1788390410.190301:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226240 00000100:00100000:3.0:1788390410.190353:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390410.190364:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103226240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390410.190399:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390410.190445:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103226240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390410.190451:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788390410.190555:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69fe69180 x1875263103226240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390410.190576:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103226240:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788390410.509856:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788390410.701432:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390411.382560:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390411.382730:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390411.383224:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757696 00000100:00100000:3.0:1788390411.383235:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757696 00000100:00080000:2.0:1788390411.383363:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390411.383375:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788390411.383387:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093757696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390411.383485:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093757696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 100us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.383492:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1788390411.383679:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757568 00000100:00100000:0.0:1788390411.383684:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757568 00000100:00100000:0.0:1788390411.383757:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:0.0:1788390411.383767:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093757568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390411.383816:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093757568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.383823:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:1.0:1788390411.387584:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390411.387781:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390411.388018:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757952 00000100:00100000:0.0:1788390411.388030:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757952 00000100:00100000:3.0:1788390411.388077:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093757824 00000100:00100000:0.0:1788390411.388168:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788390411.388179:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093757952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390411.388268:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093757952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.388274:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390411.388323:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093757824 00000100:00080000:2.0:1788390411.388728:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390411.388733:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390411.389455:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788390411.389468:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093757824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390411.395167:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093757824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 5686us (7369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.395185:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1788390411.725273:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390411.725293:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103226368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390411.725355:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390411.725510:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390411.726273:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226368 00000100:00100000:3.0:1788390411.726283:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226368 00000100:00080000:2.0:1788390411.726338:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390411.726354:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390411.726367:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103226368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390411.726402:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390411.726793:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103226368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 429us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.726802:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390411.726835:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103226368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390412.749188:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390413.773140:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390414.797507:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103226624:0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.797609:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103226752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390414.797661:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103226496:0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.801068:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390414.801252:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103226880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.801289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390414.801329:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226880 00000100:00100000:3.0:1788390414.801337:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226880 00000100:00100000:3.0:1788390414.801390:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390414.801400:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103226880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390414.801403:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390414.801428:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103227008:0@lo:400:kworker.0 00000100:00100000:0.0:1788390414.801448:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390414.801451:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103226880:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.801464:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788390414.801497:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390414.801523:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103226880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.801561:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226496 00000100:00100000:3.0:1788390414.801565:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226496 00000100:00100000:3.0:1788390414.801597:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788390414.801603:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.801631:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103226496:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.801636:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:3.0:1788390414.801671:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390414.806061:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226752 00000100:00100000:2.0:1788390414.806093:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226752 00000100:00100000:0.0:1788390414.806139:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103226496:0@lo:400:kworker.0 00000100:00100000:1.0:1788390414.806181:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390414.806235:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390414.808744:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103227136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390414.808807:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390414.808860:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227008 00000100:00100000:3.0:1788390414.808868:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227008 00000100:00100000:3.0:1788390414.808914:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103226624 00000100:00100000:3.0:1788390414.808918:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103226624 00000100:00100000:3.0:1788390414.808934:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788390414.808943:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103226752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.809034:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103226752:12345-0@lo:400:kworker.0 Request processed in 92us (7974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.809051:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788390414.809068:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788390414.809074:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.809105:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103227008:12345-0@lo:400:kworker.0 Request processed in 33us (7656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.809111:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788390414.809120:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390414.809125:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103226624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.809150:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103226624:12345-0@lo:400:kworker.0 Request processed in 25us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.809167:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390414.809201:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103226752:0@lo:400:kworker.0 00000100:00080000:3.0:1788390414.809234:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390414.809250:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103227008:0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.809270:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227136 00000100:00100000:3.0:1788390414.809273:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227136 00000100:00100000:3.0:1788390414.809299:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390414.809304:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103227136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390414.809330:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103227136:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.809335:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788390414.809348:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390414.814110:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103226624:0@lo:400:kworker.0 00010000:00080000:3.0:1788390414.814133:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a9500 x1875263103227136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390414.814145:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103227136:0@lo:400:kworker.0 00000100:00100000:2.0:1788390415.309211:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103227264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390415.309282:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390415.309354:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227264 00000100:00100000:2.0:1788390415.309362:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227264 00000100:00100000:2.0:1788390415.309462:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390415.309473:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103227264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390415.309507:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390415.309551:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103227264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.309574:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788390415.309664:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc09f100 x1875263103227264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390415.309685:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103227264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788390415.821120:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390416.501816:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390416.501863:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390416.501951:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758208 00000100:00100000:3.0:1788390416.501989:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758208 00000100:00080000:1.0:1788390416.502041:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390416.502062:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788390416.502074:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093758208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390416.502169:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093758208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390416.502177:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788390416.502279:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758080 00000100:00100000:0.0:1788390416.502283:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758080 00000100:00100000:0.0:1788390416.502314:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:0.0:1788390416.502321:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093758080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390416.502349:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2356:x1875263093758080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390416.502356:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:2.0:1788390416.510056:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390416.510147:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758336 00000100:00100000:3.0:1788390416.510158:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758336 00000100:00080000:1.0:1788390416.510220:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390416.510284:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390416.510296:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2355:x1875263093758336:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1788390416.510345:0:8777:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31e7b 00000100:00080000:3.0:1788390416.510355:0:8777:0:(import.c:65:import_set_state_nolock()) ffff95d6b6536000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390416.510404:0:8777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788390416.510640:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390416.510716:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+2:2355:x1875263093758336:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 422us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390416.510725:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390416.515999:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390416.516314:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758464 00000100:00100000:2.0:1788390416.516325:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758464 00000100:00100000:2.0:1788390416.516449:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788390416.516460:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093758464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390416.516545:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093758464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390416.516574:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00080000:1.0:1788390416.517460:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390416.845842:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103227392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390416.845914:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390416.846008:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390416.846058:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227392 00000100:00100000:2.0:1788390416.846066:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227392 00000100:00100000:2.0:1788390416.846156:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390416.846165:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103227392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390416.846200:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390416.846241:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103227392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390416.846260:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390416.846300:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103227392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390416.847007:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390417.869661:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390418.894172:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390419.917101:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390419.917283:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390419.917451:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103227648:0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.917519:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.917586:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390419.917593:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103227776:0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.917618:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.917652:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227648 00000100:00100000:1.0:1788390419.917661:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227648 00000100:00100000:1.0:1788390419.917705:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227776 00000100:00100000:1.0:1788390419.917719:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227776 00000100:00100000:1.0:1788390419.917753:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390419.917762:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.917811:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103227648:12345-0@lo:400:kworker.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.917818:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390419.917835:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788390419.917841:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.917868:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103227776:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.917873:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788390419.917890:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390419.917916:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103227776:0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.917926:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103227648:0@lo:400:kworker.0 00000100:00100000:2.0:1788390419.920314:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103227904:0@lo:400:kworker.0 00000100:00100000:2.0:1788390419.920376:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.920464:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103227520:0@lo:400:kworker.0 00000100:00100000:2.0:1788390419.920493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.920630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227520 00000100:00100000:1.0:1788390419.920638:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227520 00000100:00100000:1.0:1788390419.920689:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788390419.920699:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103227520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.920756:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a68b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103227520:12345-0@lo:400:kworker.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.920763:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788390419.920935:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390419.920945:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103228160:0@lo:400:kworker.0 00000100:00100000:0.0:1788390419.920993:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.921042:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103228032:0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.921069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.921100:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103228032 00000100:00100000:1.0:1788390419.921104:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103228032 00000100:00100000:1.0:1788390419.921137:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788390419.921143:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103228032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.921177:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103228032:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.921183:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788390419.921198:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390419.921226:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103228032:0@lo:400:kworker.0 00000100:00100000:2.0:1788390419.921329:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103227520:0@lo:400:kworker.0 00000100:00100000:3.0:1788390419.921634:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103227904 00000100:00100000:3.0:1788390419.921639:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103227904 00000100:00100000:1.0:1788390419.921743:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103228160 00000100:00100000:1.0:1788390419.921747:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103228160 00000100:00100000:1.0:1788390419.921773:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390419.921781:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103227904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.921820:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103227904:12345-0@lo:400:kworker.0 Request processed in 40us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.921826:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390419.921839:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390419.921853:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103228160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390419.921885:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103228160:12345-0@lo:400:kworker.0 Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.921890:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788390419.922022:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d69225e680 x1875263103228160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390419.922034:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103228160:0@lo:400:kworker.0 00000100:00080000:3.0:1788390419.922103:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390419.922107:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390419.922130:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103227904:0@lo:400:kworker.0 00000001:02000400:3.0:1788390420.335355:0:11806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:06:59 (1788390419) 00000100:00100000:2.0:1788390420.430039:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390420.430058:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103228288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390420.430111:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390420.430158:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103228288 00000100:00100000:2.0:1788390420.430166:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103228288 00000100:00100000:2.0:1788390420.430205:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390420.430211:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103228288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390420.430238:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390420.430269:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103228288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390420.430274:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788390420.430308:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68f5a8700 x1875263103228288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390420.430325:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103228288:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788390420.455785:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:3.0:1788390420.455791:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6b6532800/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:0.0:1788390420.455826:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6532800/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-OST0000 00000020:00000080:0.0:1788390420.455875:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6b6536000 for lustre-OST0000 00000040:00080000:0.0:1788390420.749801:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788390420.941106:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390421.621714:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390421.621755:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390421.621796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390421.621878:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758848 00000100:00100000:2.0:1788390421.621889:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758848 00000100:00100000:2.0:1788390421.621951:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758720 00000100:00100000:2.0:1788390421.621955:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758720 00000100:00100000:2.0:1788390421.622010:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788390421.622020:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093758848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390421.622091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2357:x1875263093758848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390421.622098:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788390421.622114:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788390421.622121:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093758720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390421.622158:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2357:x1875263093758720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390421.622165:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788390421.622319:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758592 00000100:00100000:3.0:1788390421.622334:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758592 00000100:00100000:3.0:1788390421.622370:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:3.0:1788390421.622377:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2357:x1875263093758592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390421.622402:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2357:x1875263093758592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390421.622419:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00080000:1.0:1788390421.622581:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390421.629652:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390421.629994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093758976 00000100:00100000:2.0:1788390421.630004:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093758976 00000100:00100000:2.0:1788390421.630066:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788390421.630076:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:10238:x1875263093758976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390421.630096:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390421.630122:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630197:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630211:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630231:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390421.630264:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390421.630267:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390421.630304:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630329:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaca expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630346:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaca expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.630354:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:2.0:1788390421.630356:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390421.630360:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:2.0:1788390421.630427:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:10238:x1875263093758976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 352us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390421.630434:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1788390421.642049:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390421.642853:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093759104 00000100:00100000:2.0:1788390421.642864:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093759104 00000100:00100000:2.0:1788390421.643016:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788390421.643027:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:10239:x1875263093759104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390421.643049:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390421.643069:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfead1 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643162:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643175:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643186:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643199:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643205:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643212:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643424:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643432:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643439:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390421.643464:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390421.643468:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390421.643485:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643516:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643524:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643531:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643536:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390421.643540:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643548:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643560:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:2.0:1788390421.643562:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390421.643567:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643572:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd31f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643583:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643588:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643593:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643603:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390421.643606:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643612:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643619:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d68641ea00) 00010000:00010000:2.0:1788390421.643622:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390421.643624:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643635:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd31f62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643661:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd31f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead1 expref: 8 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643672:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead1 expref: 7 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.643679:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390421.643681:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390421.643683:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:2.0:1788390421.643747:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:10239:x1875263093759104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 723us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390421.643753:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1788390421.646910:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390421.648898:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093759360 00000100:00100000:2.0:1788390421.648927:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093759360 00000100:00100000:2.0:1788390421.649009:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788390421.649021:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:10239:x1875263093759360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390421.649042:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390421.649062:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31f70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfead8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649136:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649152:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649164:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649242:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649251:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649258:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649605:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd31f85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649614:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd31f85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649622:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd31f85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390421.649637:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788390421.649784:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649792:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649799:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649805:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390421.649810:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649817:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649831:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390421.649834:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390421.649839:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649846:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd31f77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649858:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649864:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649881:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649886:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390421.649889:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649895:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649904:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d68641e400) 00010000:00010000:2.0:1788390421.649906:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390421.649909:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.649915:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd31f7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.650409:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd31f70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead8 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.650425:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd31f85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead8 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.650433:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390421.650435:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390421.650437:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92a00, rc 0) 00000100:00100000:2.0:1788390421.650527:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10239:x1875263093759360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1508us (3623us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788390421.650546:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390421.653160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390421.653684:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093759488 00000100:00100000:0.0:1788390421.653694:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093759488 00000100:00100000:0.0:1788390421.653753:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390421.653764:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10239:x1875263093759488:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788390421.653867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10239:x1875263093759488:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 105us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390421.653875:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000040:00080000:0.0:1788390421.773647:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788390421.965158:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390421.965201:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390421.965225:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103228416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390421.965294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390421.965396:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103228416 00000100:00100000:2.0:1788390421.965403:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103228416 00000100:00100000:2.0:1788390421.965468:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390421.965478:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103228416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390421.965525:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390421.965571:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103228416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390421.965579:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390421.965620:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103228416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390421.965664:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390422.959608:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390422.960043:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093759616 00000100:00100000:3.0:1788390422.960053:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093759616 00000100:00100000:3.0:1788390422.960244:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390422.960257:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10281:x1875263093759616:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390422.960278:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390422.960297:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeadf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960370:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960384:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960396:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960409:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960424:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960431:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960605:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960612:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960618:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960625:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390422.960629:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960637:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960654:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:3.0:1788390422.960657:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390422.960662:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960670:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd31f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960683:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960695:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960700:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960704:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390422.960707:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960713:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960719:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95d6a704c400) 00010000:00010000:3.0:1788390422.960721:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390422.960723:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960728:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd31fa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960757:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31f93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeadf expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960768:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:3.0:1788390422.960770:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390422.960774:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeadf expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390422.960783:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390422.960849:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10281:x1875263093759616:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 595us (1266us total) trans 0 rc 301/301 00000100:00100000:3.0:1788390422.960856:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788390422.967093:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390422.967129:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093759872 00000100:00100000:1.0:1788390422.967139:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093759872 00000100:00100000:1.0:1788390422.967190:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390422.967202:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10281:x1875263093759872:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:1.0:1788390422.967261:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390422.967290:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd31f4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaca expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.967306:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:1.0:1788390422.967317:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390422.968308:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.969023:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.969040:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.969057:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.969065:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.969072:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390422.971261:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788390422.971278:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971288:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971295:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971300:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390422.971305:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971311:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971339:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a600) 00010000:00010000:1.0:1788390422.971341:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390422.971346:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.971353:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd31fa8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390422.971375:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c382160 reply state 000000008e95ffe8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390422.971384:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390422.971508:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:10281:x1875263093759872:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 4292us (4407us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788390422.971517:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00010000:00010000:1.0:1788390422.974747:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974765:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974773:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974779:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390422.974784:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974792:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974825:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95d683b5ac00) 00010000:00010000:1.0:1788390422.974828:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390422.974832:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390422.974839:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd31faf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390422.989089:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390423.008690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.008815:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760000 00000100:00100000:2.0:1788390423.008826:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760000 00000100:00100000:2.0:1788390423.008893:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:2.0:1788390423.008904:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10289:x1875263093760000:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:2.0:1788390423.008927:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.008947:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd31fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeae6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009043:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009057:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009068:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390423.009116:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390423.009120:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390423.009171:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009197:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd31fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeae6 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009213:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeae6 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.009222:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:2.0:1788390423.009225:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390423.009229:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93000, rc 0) 00000100:00100000:2.0:1788390423.009291:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:10289:x1875263093760000:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 389us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.009298:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00080000:1.0:1788390423.010418:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390423.052729:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.054863:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760128 00000100:00100000:0.0:1788390423.054879:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760128 00000100:00100000:0.0:1788390423.054953:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390423.054978:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:10295:x1875263093760128:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390423.054998:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390423.055020:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd31fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaed expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055083:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055096:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055123:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055137:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055143:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055150:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055242:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055250:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055258:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390423.055284:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788390423.055293:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390423.055329:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055340:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055346:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055362:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055368:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390423.055372:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055380:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055392:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:0.0:1788390423.055395:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390423.055400:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055407:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd31fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055422:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055428:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055433:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055438:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390423.055440:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055455:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055463:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95d684d23000) 00010000:00010000:0.0:1788390423.055465:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390423.055468:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055474:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd31fd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055514:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd31fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaed expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055528:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaed expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.055535:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390423.055537:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788390423.055539:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa800, rc 0) 00000100:00100000:0.0:1788390423.055596:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:10295:x1875263093760128:12345-192.168.202.1@tcp:101:bash.0 Request processed in 634us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390423.055603:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390423.059284:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.059408:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760384 00000100:00100000:2.0:1788390423.059419:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760384 00000100:00100000:2.0:1788390423.059479:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1788390423.059490:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:10295:x1875263093760384:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390423.059522:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.059543:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd31fe0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeaf4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059674:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059705:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059717:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059776:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059785:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.059793:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390423.060576:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788390423.060834:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060845:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060854:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060886:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060893:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060900:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060906:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390423.060911:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060919:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060931:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390423.060934:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390423.060939:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.060951:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd31fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390423.061107:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061188d19 reply state 0000000099ac7701 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.061117:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788390423.061146:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd31fe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.061160:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.061166:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390423.061169:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390423.061172:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390423.061292:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10295:x1875263093760384:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1802us (2016us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788390423.061300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:2.0:1788390423.062819:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062832:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062838:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062844:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390423.062849:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062857:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062872:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.062884:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390423.062889:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.062895:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd31fee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390423.066452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.066838:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760512 00000100:00100000:1.0:1788390423.066849:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760512 00000100:00100000:1.0:1788390423.066921:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390423.066930:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263093760512:12345-192.168.202.1@tcp:8:bash.0 00010000:00080000:1.0:1788390423.066998:0:6652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1788390423.067029:0:6652:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd32003 00002000:00100000:1.0:1788390423.067041:0:6652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1107d28-9e62-443d-a57b-8cc59c78a09a/ffff95d69fc6f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390423.067063:0:6652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390423.067269:0:6652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788390423.067297:0:6652:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390423.067359:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093760512:12345-192.168.202.1@tcp:8:bash.0 Request processed in 429us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390423.067367:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390423.069489:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.069664:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760640 00000100:00100000:0.0:1788390423.069673:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760640 00000100:00100000:0.0:1788390423.069771:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390423.069790:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:0:x1875263093760640:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390423.069806:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390423.069829:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeafb expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390423.069854:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390423.069869:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=240s v=(0 0) 00010000:00010000:0.0:1788390423.069873:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390423.069882:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 7 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.069901:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 7 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.069913:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb000, rc 0) 00000100:00100000:0.0:1788390423.070000:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:0:x1875263093760640:12345-192.168.202.1@tcp:101:bash.0 Request processed in 211us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390423.070008:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00080000:1.0:1788390423.070501:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390423.072322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390423.072426:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760768 00000100:00100000:3.0:1788390423.072435:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760768 00000100:00100000:3.0:1788390423.072483:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390423.072503:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:10295:x1875263093760768:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390423.072519:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390423.072536:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb02 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.072577:0:8777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 8 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.072586:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390423.072589:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390423.072604:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.072635:0:8777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 8 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.072648:0:8777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 8 pid: 6653 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.072663:0:8777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8777:1875263103228544:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390423.072781:0:8777:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390423.075575:0:8777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8777:1875263103228544:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390423.075610:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788390423.075611:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.075631:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:2.0:1788390423.075708:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093760896 00000100:00100000:2.0:1788390423.075715:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093760896 00010000:00010000:2.0:1788390423.075756:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 9 pid: 6653 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.075787:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788390423.075796:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093760896:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390423.075809:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390423.075831:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 9 pid: 6653 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.075839:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10295:x1875263093760768:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3347us (3523us total) trans 0 rc 0/0 00010000:00010000:2.0:1788390423.075843:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 9 pid: 6653 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.075846:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:2.0:1788390423.075866:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cecbb768/0x9aafc5f04cd3200a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeafb expref: 8 pid: 6653 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.075879:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390423.075883:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390423.075891:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.075912:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.075955:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.075996:0:5792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1875263103228672:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390423.076042:0:5792:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390423.079940:0:5792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5792:1875263103228672:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390423.080117:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390423.080179:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093760896:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4383us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390423.080189:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390423.080671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.080755:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093761152 00000100:00100000:2.0:1788390423.080763:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093761152 00000100:00100000:2.0:1788390423.080816:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390423.080826:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:10295:x1875263093761152:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788390423.081238:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10295:x1875263093761152:12345-192.168.202.1@tcp:35:bash.0 Request processed in 413us (568us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788390423.081247:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390423.149885:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.150268:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093761408 00000100:00100000:0.0:1788390423.150288:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093761408 00000100:00100000:0.0:1788390423.150459:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390423.150484:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10305:x1875263093761408:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390423.150520:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390423.150544:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd32018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb09 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390423.150636:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788390423.150759:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd32018 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb09 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.150774:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:0.0:1788390423.150777:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390423.150782:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd32018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb09 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.150812:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb000, rc 0) 00000100:00100000:0.0:1788390423.150872:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:10305:x1875263093761408:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 390us (1084us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788390423.150879:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390423.155946:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.156244:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093761664 00000100:00100000:1.0:1788390423.156255:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093761664 00000100:00100000:1.0:1788390423.156367:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390423.156379:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:10305:x1875263093761664:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390423.156649:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:10305:x1875263093761664:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 271us (710us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788390423.156658:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390423.220383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.220535:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093761792 00000100:00100000:2.0:1788390423.220545:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093761792 00000100:00100000:2.0:1788390423.220605:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788390423.220616:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:10311:x1875263093761792:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390423.220640:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.220661:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd32026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220749:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220764:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220775:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390423.220823:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788390423.220827:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390423.220848:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220874:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd32026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb10 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220892:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb10 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.220900:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390423.220902:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390423.220906:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:2.0:1788390423.221019:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:10311:x1875263093761792:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 404us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.221027:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788390423.223674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.223738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762048 00000100:00100000:1.0:1788390423.223749:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762048 00000100:00100000:1.0:1788390423.223819:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788390423.223831:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:10311:x1875263093762048:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390423.223852:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390423.223871:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb17 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.224017:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3203b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.224032:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.224056:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390423.224068:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788390423.224634:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb17 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.224652:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3203b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb17 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.224661:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390423.224664:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390423.224667:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390423.224727:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:10311:x1875263093762048:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 898us (1062us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788390423.224735:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788390423.229894:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.230011:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.230054:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762304 00000100:00100000:2.0:1788390423.230063:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762304 00000100:00100000:2.0:1788390423.230141:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1788390423.230151:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:10311:x1875263093762304:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390423.230174:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.230194:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd32049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb1e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.230288:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.230304:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.230315:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390423.230326:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390423.230455:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd32049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb1e expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.230473:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb1e expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.230481:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:2.0:1788390423.230485:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390423.230488:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:2.0:1788390423.230563:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10311:x1875263093762304:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 413us (678us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788390423.230571:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1788390423.232302:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762432 00000100:00100000:3.0:1788390423.232311:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762432 00000100:00100000:3.0:1788390423.232363:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390423.232370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:2358:x1875263093762432:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390423.232390:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390423.232419:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3203b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb17 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.232435:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390423.232440:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390423.232480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:2358:x1875263093762432:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 110us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390423.232488:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390423.237345:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390423.237427:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762560 00000100:00100000:3.0:1788390423.237437:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762560 00000100:00100000:3.0:1788390423.237508:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1788390423.237519:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093762560:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1788390423.237562:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.237582:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.237591:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390423.237596:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390423.237600:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.237635:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.237667:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 7 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.237684:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103228800:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390423.237772:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390423.241488:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.241579:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762688 00000100:00100000:1.0:1788390423.241589:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762688 00002000:00100000:1.0:1788390423.241634:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff95d69225f480 x1875263093762688/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:39/0 lens 504/0 e 0 to 0 dl 1788390434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390423.241645:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225f480 with x1875263093762688 ext(0->12) 00010000:00010000:1.0:1788390423.241654:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 8 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.241671:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 8 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390423.241696:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d69225f480 00000100:00100000:1.0:1788390423.241733:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390423.241743:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093762688:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:3.0:1788390423.243853:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103228800:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390423.243879:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788390423.270217:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000100:00100000:1.0:1788390423.270776:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093762688:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 29029us (29292us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788390423.270788:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:1.0:1788390423.270800:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff95d69225f480 x1875263093762688/t4294967299(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:39/0 lens 504/448 e 0 to 0 dl 1788390434 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390423.270817:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225f480 with x1875263093762688 ext(0->12) 00010000:00010000:1.0:1788390423.270827:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.270845:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390423.270853:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d69225f480 00000100:00100000:0.0:1788390423.274180:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.274316:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093762816 00000100:00100000:1.0:1788390423.274326:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093762816 00010000:00010000:1.0:1788390423.274363:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.274441:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390423.274451:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093762816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390423.274478:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788390423.274508:0:11126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788390423.274511:0:11126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788390423 00002000:00010000:1.0:1788390423.274513:0:11126:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788390423 00002000:00010000:1.0:1788390423.274516:0:11126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788390423 00010000:00010000:1.0:1788390423.274522:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.274535:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.274559:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd32011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb02 expref: 9 pid: 8777 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.274576:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390423.274581:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390423.274587:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.274598:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.274655:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390423.274716:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093762816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 267us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390423.274724:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00010000:00010000:3.0:1788390423.275157:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275168:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275192:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275199:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275208:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275226:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390423.275230:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275460:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275478:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.275486:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3205e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.275562:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093762560:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 38044us (38226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390423.275570:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390423.284211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.284347:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763072 00000100:00100000:2.0:1788390423.284367:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763072 00000100:00100000:2.0:1788390423.284416:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788390423.284426:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10311:x1875263093763072:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1788390423.284486:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb1e expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390423.284752:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788390423.284787:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788390423.286080:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788390423.286133:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.286147:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.286153:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.286183:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.286194:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 24 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.286205:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103228928:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390423.286414:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390423.288840:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103228928:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390423.288866:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390423.289478:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390423.289700:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763200 00000100:00100000:3.0:1788390423.289708:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763200 00010000:00010000:3.0:1788390423.289742:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 25 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.289865:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788390423.289873:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:2356:x1875263093763200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390423.289884:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390423.289889:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 25 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289897:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 25 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289912:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd31ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaf4 expref: 25 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289926:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390423.289929:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289935:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289939:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.289996:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390423.290029:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:2356:x1875263093763200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 158us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390423.290034:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00010000:00010000:2.0:1788390423.290075:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.290080:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390423.290172:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788390423.290319:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788390423.290424:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103229056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390423.290467:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390423.290500:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390423.290522:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103229056 00000100:00100000:2.0:1788390423.290526:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103229056 00000100:00100000:2.0:1788390423.290563:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390423.290570:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103229056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390423.290633:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103229056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.290638:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390423.290662:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103229056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788390423.291112:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788390423.291143:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc743800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103229184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390423.291162:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390423.291172:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390423.291181:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103229184 00000100:00100000:2.0:1788390423.291183:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103229184 00000100:00100000:2.0:1788390423.291197:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390423.291201:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103229184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390423.291289:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1875263103229184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (126us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788390423.291294:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390423.291315:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc743800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103229184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788390423.291343:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788390423.291363:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291368:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291373:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291376:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390423.291379:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291384:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291393:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:2.0:1788390423.291395:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788390423.291397:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.291400:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32065 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390423.291540:0:5809:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788390423.291722:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788390423.291733:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240398772271ns, next at 241398769649ns, rc = 0 00000001:00080000:2.0:1788390423.291740:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788390423.291770:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:2.0:1788390423.291773:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390423.291785:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32050 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb1e expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.291862:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:10311:x1875263093763072:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 7437us (7661us total) trans 4294967325 rc 0/0 00000100:00080000:0.0:1788390423.291867:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390423.291870:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000020:00080000:2.0:1788390423.291873:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788390423.293428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.293512:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763328 00000100:00100000:2.0:1788390423.293517:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763328 00000100:00100000:2.0:1788390423.293550:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788390423.293556:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:10311:x1875263093763328:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390423.293571:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.293585:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd3206c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb25 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.293620:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd3206c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb25 expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.293630:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd3206c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb25 expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.293644:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.293647:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390423.293650:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:2.0:1788390423.293682:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10311:x1875263093763328:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 126us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.293689:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788390423.295509:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.295568:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763584 00000100:00100000:1.0:1788390423.295575:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763584 00000100:00100000:1.0:1788390423.295612:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390423.295621:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10311:x1875263093763584:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390423.295855:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:10311:x1875263093763584:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 235us (362us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788390423.295860:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390423.347732:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.348552:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763840 00000100:00100000:1.0:1788390423.348564:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763840 00000100:00100000:1.0:1788390423.348635:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1788390423.348648:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:10321:x1875263093763840:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390423.348677:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390423.348700:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb2c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390423.348792:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788390423.348907:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32073 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb2c expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.348920:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390423.348922:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390423.348925:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb2c expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.348936:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390423.349039:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:10321:x1875263093763840:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 394us (1317us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788390423.349063:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390423.360404:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.360604:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093763968 00000100:00100000:1.0:1788390423.360614:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093763968 00000100:00100000:1.0:1788390423.360710:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788390423.360726:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:10321:x1875263093763968:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788390423.360805:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360824:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360837:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360852:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360859:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360866:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360952:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360988:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.360995:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390423.361051:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361063:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361069:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361077:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361083:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.361087:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361094:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361106:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390423.361109:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.361113:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361119:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361131:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361137:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361149:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361153:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.361157:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361163:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361171:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ac00) 00010000:00010000:1.0:1788390423.361174:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.361176:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361182:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361200:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361205:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361210:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361215:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.361217:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361230:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361238:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390423.361239:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.361242:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.361247:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3208f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.361327:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:10321:x1875263093763968:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 603us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390423.361335:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788390423.363170:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.363244:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093764224 00000100:00100000:2.0:1788390423.363252:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093764224 00000100:00100000:2.0:1788390423.363319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390423.363326:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:10321:x1875263093764224:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390423.363644:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:10321:x1875263093764224:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 316us (478us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788390423.363652:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390423.389680:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.389810:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093764480 00000100:00100000:1.0:1788390423.389821:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093764480 00000100:00100000:1.0:1788390423.389885:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788390423.389896:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:10324:x1875263093764480:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390423.389920:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390423.389938:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb33 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390019:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390030:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390038:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390059:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390064:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390068:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390158:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390163:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390167:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390423.390173:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788390423.390241:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390246:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390250:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390253:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.390256:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390268:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390277:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390423.390278:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.390281:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390285:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3209d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390294:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390297:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390301:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390304:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.390305:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390308:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390312:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ac00) 00010000:00010000:1.0:1788390423.390313:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.390314:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390323:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390362:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390374:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.390382:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390423.390384:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390423.390387:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390423.390530:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10324:x1875263093764480:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 635us (860us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788390423.390538:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788390423.392506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.392609:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093764608 00000100:00100000:2.0:1788390423.392620:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093764608 00000100:00100000:2.0:1788390423.392673:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788390423.392684:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10324:x1875263093764608:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1788390423.392743:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392758:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392768:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392792:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392799:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392806:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392811:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390423.392833:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392841:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392853:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.392856:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390423.392860:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.392867:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.393013:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10324:x1875263093764608:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 330us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.393021:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390423.394730:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.396100:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093764864 00000100:00100000:1.0:1788390423.396112:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093764864 00000100:00100000:1.0:1788390423.396176:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390423.396186:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10324:x1875263093764864:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390423.396637:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:10324:x1875263093764864:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 452us (1923us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788390423.396645:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390423.601697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.601793:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093765120 00000100:00100000:1.0:1788390423.601803:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093765120 00000100:00100000:1.0:1788390423.601853:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1788390423.601861:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:10355:x1875263093765120:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1788390423.601897:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390423.601918:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd320c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb3a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.602040:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.602052:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.602060:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390423.602068:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788390423.602179:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd320c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb3a expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.602192:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb3a expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.602198:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390423.602201:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390423.602203:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390423.602259:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10355:x1875263093765120:12345-192.168.202.1@tcp:101:cat.0 Request processed in 400us (572us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788390423.602264:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390423.606064:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.606284:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093765376 00000100:00100000:2.0:1788390423.606295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093765376 00000100:00100000:2.0:1788390423.606347:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390423.606358:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10355:x1875263093765376:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:2.0:1788390423.606790:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:10355:x1875263093765376:12345-192.168.202.1@tcp:35:cat.0 Request processed in 432us (733us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788390423.606799:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390423.608870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.608952:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093765504 00000100:00100000:0.0:1788390423.608973:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093765504 00000100:00100000:0.0:1788390423.609024:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390423.609032:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:2356:x1875263093765504:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390423.609043:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390423.609064:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd320c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb3a expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.609077:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390423.609080:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390423.609112:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:2356:x1875263093765504:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390423.609116:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390423.666381:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.666673:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093765760 00000100:00100000:2.0:1788390423.666681:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093765760 00000100:00100000:2.0:1788390423.666789:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1788390423.666800:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10361:x1875263093765760:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788390423.666826:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390423.666842:0:8163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390423.666868:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd3202d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb10 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667010:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390423.667015:0:8163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390423.667029:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb41 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667125:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667140:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667148:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667181:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.667193:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 36 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.667206:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103229312:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390423.667330:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390423.670931:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103229312:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390423.670978:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390423.671434:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390423.671910:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093765888 00000100:00100000:1.0:1788390423.671917:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093765888 00010000:00010000:1.0:1788390423.671951:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 37 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.672011:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1788390423.672018:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:2356:x1875263093765888:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390423.672031:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390423.672036:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 37 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672044:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 37 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672060:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd320ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb33 expref: 37 pid: 5805 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672071:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390423.672075:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672081:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672086:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.672101:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390423.672146:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:2356:x1875263093765888:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 129us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390423.672150:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00010000:00010000:2.0:1788390423.672245:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.672250:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390423.672265:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390423.672423:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd320d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 37 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.672434:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 36 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.672439:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.672441:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390423.672442:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:2.0:1788390423.672460:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10361:x1875263093765760:12345-192.168.202.1@tcp:101:dd.0 Request processed in 5665us (6089us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788390423.672465:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1788390423.674716:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390423.674922:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093766144 00000100:00100000:3.0:1788390423.674937:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093766144 00000100:00100000:3.0:1788390423.675116:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1788390423.675127:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10361:x1875263093766144:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1788390423.675420:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.675436:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390423.675446:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390423.675511:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788390423.675536:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006967d396 reply state 00000000d43d5003 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390423.675544:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390423.675646:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:10361:x1875263093766144:12345-192.168.202.1@tcp:36:dd.0 Request processed in 520us (937us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788390423.675653:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000020:00080000:3.0:1788390423.675658:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390423.676939:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.676950:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.676984:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.676991:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390423.676996:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.677003:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.677019:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390423.677022:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390423.677026:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390423.677032:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd320ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.850429:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.850552:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093766272 00000100:00100000:0.0:1788390423.850562:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093766272 00000100:00100000:0.0:1788390423.850703:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1788390423.850713:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:10375:x1875263093766272:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1788390423.850739:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390423.850771:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd320f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb48 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850836:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850851:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850863:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850877:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850884:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850890:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.850994:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.851006:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 39 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.851013:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.851046:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 39 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.851068:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 39 pid: 8163 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390423.851081:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103229440:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390423.851164:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390423.852680:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103229440:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390423.852706:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390423.852995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390423.853076:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093766528 00000100:00100000:0.0:1788390423.853083:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093766528 00000100:00100000:0.0:1788390423.853136:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390423.853147:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:5589:x1875263093766528:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788390423.853520:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:5589:x1875263093766528:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 373us (558us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788390423.853527:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390423.856456:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.857480:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093766656 00000100:00100000:2.0:1788390423.857506:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093766656 00010000:00010000:2.0:1788390423.857552:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 41 pid: 8163 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.857603:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1788390423.857614:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:2357:x1875263093766656:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390423.857631:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390423.857656:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 41 pid: 8163 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857672:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 41 pid: 8163 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857698:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd320dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb41 expref: 41 pid: 8163 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857717:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.857721:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857730:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857738:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.857770:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390423.857851:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:2357:x1875263093766656:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 238us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390423.857859:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:0.0:1788390423.857955:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.857993:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390423.858039:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788390423.858044:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390423.858086:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858099:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858119:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858125:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858132:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858138:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390423.858143:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858150:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858160:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390423.858162:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390423.858179:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858186:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd320f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858197:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858203:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858209:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858220:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390423.858224:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858230:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858239:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d684d23100) 00010000:00010000:0.0:1788390423.858253:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390423.858257:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858263:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd320ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858300:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd320f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb48 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858313:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb48 expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390423.858320:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390423.858322:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390423.858325:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788390423.858351:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:10375:x1875263093766272:12345-192.168.202.1@tcp:101:stat.0 Request processed in 7640us (7931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390423.858358:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1788390423.923151:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390423.923293:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093766912 00000100:00100000:2.0:1788390423.923303:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093766912 00000100:00100000:2.0:1788390423.923364:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788390423.923375:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:10381:x1875263093766912:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:2.0:1788390423.923444:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390423.923483:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb48 expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.923523:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.923529:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390423.923767:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.923781:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.923791:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390423.923838:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788390423.923860:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c841e74 reply state 00000000227a4d8c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390423.923868:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390423.924018:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:10381:x1875263093766912:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 645us (875us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788390423.924025:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000020:00080000:2.0:1788390423.924029:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788390423.926322:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926338:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926347:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926353:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390423.926373:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926381:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926408:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390423.926412:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390423.926416:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390423.926423:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3210d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.013208:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390424.073708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.073817:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093767040 00000100:00100000:2.0:1788390424.073832:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093767040 00000100:00100000:2.0:1788390424.073994:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390424.074005:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:10395:x1875263093767040:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:2.0:1788390424.074030:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.074051:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb4f expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074116:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074129:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074140:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074172:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074179:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074186:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074269:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074277:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074284:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390424.074317:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788390424.074321:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390424.074342:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074354:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074362:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074369:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074384:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074390:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.074394:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074401:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074414:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390424.074417:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390424.074421:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074427:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3211b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074441:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074447:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074453:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074458:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.074461:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074475:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074496:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d68641e500) 00010000:00010000:2.0:1788390424.074498:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390424.074502:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074508:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074538:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 42 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074551:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 41 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.074557:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390424.074560:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390424.074562:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:2.0:1788390424.074630:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:10395:x1875263093767040:12345-192.168.202.1@tcp:101:stat.0 Request processed in 627us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.074637:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788390424.123182:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.124276:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093767296 00000100:00100000:1.0:1788390424.124291:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093767296 00000100:00100000:1.0:1788390424.124380:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390424.124391:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:10405:x1875263093767296:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390424.124412:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390424.124430:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb56 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390424.124599:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788390424.124726:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32130 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb56 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.124740:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390424.124743:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390424.124749:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb56 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.124764:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390424.124830:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:10405:x1875263093767296:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 441us (1660us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788390424.124837:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788390424.126673:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.126766:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093767552 00000100:00100000:2.0:1788390424.126778:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093767552 00000100:00100000:2.0:1788390424.126837:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390424.126847:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:10405:x1875263093767552:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390424.127097:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:10405:x1875263093767552:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 250us (435us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788390424.127106:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390424.155062:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390424.155198:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093767808 00000100:00100000:0.0:1788390424.155224:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093767808 00000100:00100000:0.0:1788390424.155282:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1788390424.155291:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:10411:x1875263093767808:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390424.155318:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390424.155341:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3213e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb5d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.155460:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.155476:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 44 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.155496:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.155539:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 44 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.155551:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 44 pid: 8163 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390424.155564:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103229568:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390424.155668:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390424.157208:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.157295:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093767936 00000100:00100000:1.0:1788390424.157309:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093767936 00010000:00010000:1.0:1788390424.157351:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 45 pid: 8163 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390424.157390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1788390424.157401:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+45:2356:x1875263093767936:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390424.157418:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390424.157437:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 45 pid: 8163 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.157453:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 45 pid: 8163 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.157475:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.157480:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.157532:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.157540:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.157562:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390424.157601:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb4f expref: 45 pid: 8163 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390424.157630:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103229568:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390424.157635:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+44:2356:x1875263093767936:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 232us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.157650:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00010000:00010000:0.0:1788390424.157682:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.157697:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.157709:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390424.157731:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788390424.157923:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3213e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 45 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.157940:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 44 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.157950:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390424.157953:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390424.157957:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788390424.158396:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+44:10411:x1875263093767808:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3103us (3343us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788390424.158405:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788390424.159868:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.160185:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093768192 00000100:00100000:1.0:1788390424.160197:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093768192 00000100:00100000:1.0:1788390424.160267:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1788390424.160281:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+44:10411:x1875263093768192:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1788390424.160614:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.160635:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.160649:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390424.160726:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788390424.160754:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e6bb315 reply state 00000000c42d2af4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390424.160764:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390424.160864:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+47:10411:x1875263093768192:12345-192.168.202.1@tcp:36:bash.0 Request processed in 586us (1004us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788390424.160872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000020:00080000:1.0:1788390424.160877:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390424.162981:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163000:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163010:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163016:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.163023:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163031:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163052:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.163055:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390424.163061:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.163068:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390424.165589:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.165721:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093768320 00000100:00100000:2.0:1788390424.165735:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093768320 00000100:00100000:2.0:1788390424.165812:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788390424.165825:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10411:x1875263093768320:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390424.165859:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.165886:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3215a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb64 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.166292:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.166312:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.166321:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.166360:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.166374:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 47 pid: 5806 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390424.166397:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103229696:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390424.166552:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390424.167735:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103229696:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390424.167761:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390424.168035:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.168098:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093768448 00000100:00100000:2.0:1788390424.168106:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093768448 00010000:00010000:2.0:1788390424.168137:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 48 pid: 5806 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390424.168205:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788390424.168213:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:2357:x1875263093768448:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390424.168226:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390424.168231:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 48 pid: 5806 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168241:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 48 pid: 5806 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168261:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb5d expref: 48 pid: 5806 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168273:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788390424.168277:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168284:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168302:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.168326:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390424.168386:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+47:2357:x1875263093768448:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 173us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.168393:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00010000:00010000:0.0:1788390424.168420:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.168431:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390424.168509:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788390424.168514:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390424.168561:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.168608:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd3215a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb64 expref: 47 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.168624:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb64 expref: 46 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.168631:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390424.168634:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390424.168636:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:0.0:1788390424.168669:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10411:x1875263093768320:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2849us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390424.168674:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788390424.170584:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.170644:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093768704 00000100:00100000:2.0:1788390424.170657:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093768704 00000100:00100000:2.0:1788390424.170721:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788390424.170732:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10411:x1875263093768704:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788390424.171029:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+47:10411:x1875263093768704:12345-192.168.202.1@tcp:35:bash.0 Request processed in 298us (452us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788390424.171038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390424.206952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.207177:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093768960 00000100:00100000:2.0:1788390424.207194:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093768960 00000100:00100000:2.0:1788390424.207513:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788390424.207526:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+47:10422:x1875263093768960:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390424.207560:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.207585:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb6b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.207726:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd3216f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.207743:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd3216f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.207781:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd3216f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390424.207795:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788390424.207954:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb6b expref: 50 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.208006:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd3216f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb6b expref: 49 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.208017:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390424.208020:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390424.208025:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92800, rc 0) 00000100:00100000:2.0:1788390424.208103:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10422:x1875263093768960:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 579us (1165us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788390424.208112:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1788390424.210004:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390424.210134:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093769088 00000100:00100000:0.0:1788390424.210151:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093769088 00000100:00100000:0.0:1788390424.210222:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1788390424.210235:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10422:x1875263093769088:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788390424.210324:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210355:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210369:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210387:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210428:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210436:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210556:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210563:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210568:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390424.210612:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210624:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210629:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210634:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210638:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390424.210642:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210647:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210662:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390424.210664:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390424.210668:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210675:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3217d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210690:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210697:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210703:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210709:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390424.210712:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210718:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210726:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d684d23100) 00010000:00010000:0.0:1788390424.210729:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390424.210731:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210737:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd32184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210764:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210771:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210777:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210782:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390424.210785:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210791:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210799:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390424.210802:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390424.210805:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.210811:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3218b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390424.210901:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10422:x1875263093769088:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 663us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390424.210910:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788390424.236096:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.236215:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093769344 00000100:00100000:1.0:1788390424.236229:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093769344 00000100:00100000:1.0:1788390424.236365:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788390424.236379:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10425:x1875263093769344:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390424.236406:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390424.236430:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb72 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236538:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236556:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236571:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236588:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236595:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236601:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236767:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236776:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.236801:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390424.236813:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788390424.237009:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237018:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237025:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237031:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.237036:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237045:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237059:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390424.237063:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390424.237068:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237075:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32199 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237089:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237095:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237108:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237114:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.237117:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237124:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237133:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ac00) 00010000:00010000:1.0:1788390424.237136:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390424.237138:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237144:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237199:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb72 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237215:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb72 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.237223:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.237226:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390424.237229:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390424.237321:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10425:x1875263093769344:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 944us (1239us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788390424.237339:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788390424.240181:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.240280:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.240331:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093769600 00000100:00100000:1.0:1788390424.240345:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093769600 00000100:00100000:1.0:1788390424.240419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788390424.240432:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10425:x1875263093769600:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1788390424.240534:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240552:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240562:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240589:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240595:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240600:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240603:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.240607:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240612:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240621:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.240629:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1788390424.240790:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093769472 00000100:00100000:0.0:1788390424.240796:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093769472 00000100:00100000:0.0:1788390424.240892:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1788390424.240909:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:2356:x1875263093769472:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390424.240925:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390424.240946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb72 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.240987:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.240993:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.240999:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.241000:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390424.241092:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10425:x1875263093769600:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 653us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.241103:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1788390424.241141:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+50:2356:x1875263093769472:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 233us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390424.241149:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390424.244441:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.244516:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093769856 00000100:00100000:2.0:1788390424.244528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093769856 00000100:00100000:2.0:1788390424.244598:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390424.244612:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+50:10425:x1875263093769856:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390424.244913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10425:x1875263093769856:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 303us (482us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788390424.244922:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390424.330802:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.330926:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093770112 00000100:00100000:3.0:1788390424.330939:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093770112 00000100:00100000:3.0:1788390424.331031:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1788390424.331041:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10443:x1875263093770112:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1788390424.331070:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390424.331095:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd321bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.331331:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd321c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.331349:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd321c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.331363:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd321c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390424.331377:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788390424.331669:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd321bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb79 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.331723:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd321c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb79 expref: 53 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.331733:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:3.0:1788390424.331736:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788390424.331740:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390424.332935:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10443:x1875263093770112:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1884us (2134us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788390424.332948:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1788390424.347815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.347908:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093770240 00000100:00100000:2.0:1788390424.347920:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093770240 00000100:00100000:2.0:1788390424.348059:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390424.348070:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10444:x1875263093770240:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390424.348099:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.348122:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd321d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb80 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348210:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348225:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348245:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390424.348297:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788390424.348300:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390424.348317:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348350:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd321d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb80 expref: 55 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348382:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb80 expref: 54 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.348392:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390424.348395:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390424.348398:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:2.0:1788390424.348466:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10444:x1875263093770240:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 397us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.348479:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1788390424.351575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.351675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093770624 00000100:00100000:1.0:1788390424.351690:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093770624 00000100:00100000:1.0:1788390424.351758:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788390424.351772:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10444:x1875263093770624:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390424.352243:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10444:x1875263093770624:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 473us (679us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788390424.352252:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390424.355684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.355770:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093770752 00000100:00100000:1.0:1788390424.355784:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093770752 00000100:00100000:1.0:1788390424.355875:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390424.355889:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10444:x1875263093770752:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1788390424.355907:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788390424.355938:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd32161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb64 expref: 55 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.356000:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd321c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb79 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.356043:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd3206c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb25 expref: 53 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.356054:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788390424.356064:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390424.356189:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10444:x1875263093770752:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 243us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.356197:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390424.360860:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.360927:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093770880 00000100:00100000:1.0:1788390424.360940:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093770880 00000100:00100000:1.0:1788390424.361050:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1788390424.361064:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10444:x1875263093770880:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1788390424.361235:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.361253:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.361266:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390424.361668:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390424.361926:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788390424.362048:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788390424.362174:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10444:x1875263093770880:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1112us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.362184:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1788390424.375532:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.375622:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771008 00000100:00100000:1.0:1788390424.375635:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771008 00000100:00100000:1.0:1788390424.375718:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1788390424.375732:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10446:x1875263093771008:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390424.375757:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390424.375783:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd321e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb87 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375866:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375883:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375898:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375914:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375921:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.375928:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376308:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376318:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376349:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390424.376396:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788390424.376401:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390424.376425:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376438:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376447:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376455:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376463:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376469:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.376474:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376492:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376507:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390424.376510:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390424.376515:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376532:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd321ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376545:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376553:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376559:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376565:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.376569:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376577:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376585:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5a600) 00010000:00010000:1.0:1788390424.376588:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390424.376590:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376596:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd321f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376638:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd321e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376653:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.376666:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:1.0:1788390424.376669:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390424.376673:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390424.376808:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10446:x1875263093771008:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1078us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.376816:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000040:00080000:0.0:1788390424.845211:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390424.845222:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390424.845273:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788390424.845285:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390424.845444:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103229824:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390424.845637:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390424.852550:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103229824:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390424.862878:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390424.863000:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771136 00000100:00100000:0.0:1788390424.863018:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771136 00000100:00100000:0.0:1788390424.863090:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788390424.863103:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771136:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788390424.863211:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771136:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 110us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390424.863219:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788390424.868681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.868787:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771264 00000100:00100000:3.0:1788390424.868805:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771264 00000100:00100000:3.0:1788390424.868894:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788390424.868905:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771264:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390424.868938:0:5807:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390424.869091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771264:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 188us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390424.869099:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788390424.873752:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.874115:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771392 00000100:00100000:2.0:1788390424.874142:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771392 00000100:00100000:2.0:1788390424.874227:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788390424.874242:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771392:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788390424.874347:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.874370:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.874575:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877014:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877038:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877051:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877086:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877096:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877104:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390424.877162:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390424.877166:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390424.877179:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877191:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877198:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877204:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877209:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.877213:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877220:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877233:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390424.877236:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390424.877240:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877245:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32202 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877255:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877269:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877275:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877280:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.877283:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877289:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877297:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff95d68641e500) 00010000:00010000:2.0:1788390424.877299:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390424.877302:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877307:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32209 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877321:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877328:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877334:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877338:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.877347:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877353:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877361:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:2.0:1788390424.877363:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390424.877366:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.877372:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390424.877473:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771392:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 3230us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.877496:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788390424.887626:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.887740:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771648 00000100:00100000:2.0:1788390424.887750:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771648 00000100:00100000:2.0:1788390424.887809:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1788390424.887820:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10457:x1875263093771648:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390424.887850:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.887879:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb8e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.887989:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888003:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888024:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390424.888035:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788390424.888126:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888134:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888141:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888146:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390424.888150:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888156:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888168:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:2.0:1788390424.888171:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390424.888176:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888183:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3221e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888216:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32217 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb8e expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888236:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390424.888239:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390424.888243:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb8e expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.888253:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:2.0:1788390424.888302:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093771648:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 484us (685us total) trans 4294967350 rc 301/301 00000100:00100000:2.0:1788390424.888309:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390424.892071:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.892163:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093771776 00000100:00100000:1.0:1788390424.892173:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093771776 00000100:00100000:1.0:1788390424.892234:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788390424.892245:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093771776:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390424.892279:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390424.892395:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093771776:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.892403:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788390424.900400:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.900594:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772032 00000100:00100000:3.0:1788390424.900605:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772032 00000100:00100000:3.0:1788390424.900666:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1788390424.900677:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093772032:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390424.900697:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390424.900699:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390424.900954:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd321d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb80 expref: 54 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.901653:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390424.901658:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390424.901673:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3222c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb95 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390424.902213:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788390424.902414:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.902426:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.902436:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.902608:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3222c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb95 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.902627:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb95 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.902634:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:3.0:1788390424.902643:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390424.902646:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390424.902803:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10457:x1875263093772032:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2127us (2410us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788390424.902811:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788390424.906344:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390424.906404:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772288 00000100:00100000:0.0:1788390424.906412:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772288 00000100:00100000:0.0:1788390424.906454:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1788390424.906461:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10457:x1875263093772288:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390424.906530:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390424.906557:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb95 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906576:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788390424.906585:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390424.906606:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906615:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906631:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906641:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906646:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906650:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906703:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906721:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906727:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906733:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390424.906736:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906744:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906752:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390424.906754:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390424.906758:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906763:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32241 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906770:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906774:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906778:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906780:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390424.906786:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906790:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906795:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9ef70f84 (ffff95d684d23d00) 00010000:00010000:0.0:1788390424.906796:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390424.906797:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390424.906801:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ef70f84 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390424.906872:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093772288:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 411us (537us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390424.906877:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788390424.909525:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390424.909609:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772416 00000100:00100000:2.0:1788390424.909630:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772416 00000100:00100000:2.0:1788390424.909682:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788390424.909690:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10457:x1875263093772416:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390424.909708:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390424.909728:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3224f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeb9c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.909761:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.909774:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.909784:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.909957:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3224f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.910072:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390424.910078:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390424.910080:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390424.910082:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:2.0:1788390424.910135:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10457:x1875263093772416:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 446us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.910140:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788390424.912832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.913634:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772672 00000100:00100000:1.0:1788390424.913653:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772672 00000100:00100000:1.0:1788390424.913750:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788390424.913761:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10457:x1875263093772672:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390424.914489:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.914508:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.914534:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390424.915079:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788390424.915090:0:8163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242022128320ns, next at 243022126088ns, rc = 0 00000004:00010000:1.0:1788390424.915178:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f966af5 reply state 00000000eb0e8365 transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390424.915187:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390424.915297:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:10457:x1875263093772672:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1535us (2476us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788390424.915305:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00010000:00010000:1.0:1788390424.917157:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917173:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917180:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917185:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390424.917190:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917197:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917216:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390424.917219:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390424.917228:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.917235:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3225d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390424.918453:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.918515:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772800 00000100:00100000:1.0:1788390424.918525:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772800 00000100:00100000:1.0:1788390424.918573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390424.918583:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:10457:x1875263093772800:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390424.918605:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390424.918688:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeba3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.918746:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.918760:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.918779:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390424.918783:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390424.918785:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390424.919116:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:10457:x1875263093772800:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 531us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.919123:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788390424.921493:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.921715:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093772928 00000100:00100000:1.0:1788390424.921725:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093772928 00000100:00100000:1.0:1788390424.921771:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390424.921786:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263093772928:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788390424.921815:0:6652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788390424.921952:0:6652:0:(genops.c:1385:class_connect()) connect: client c1107d28-9e62-443d-a57b-8cc59c78a09a, cookie 0x9aafc5f04cd3226b 00002000:00100000:1.0:1788390424.921984:0:6652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1107d28-9e62-443d-a57b-8cc59c78a09a/ffff95d69fc68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390424.922008:0:6652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390424.922183:0:6652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390424.922206:0:6652:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390424.922260:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2355:x1875263093772928:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 Request processed in 475us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.922268:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788390424.925318:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.925404:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093773056 00000100:00100000:3.0:1788390424.925413:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093773056 00000100:00100000:3.0:1788390424.925500:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390424.925671:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:0:x1875263093773056:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788390424.926694:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788390424.951014:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000001:00080000:1.0:1788390424.951030:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788390424.951436:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:0:x1875263093773056:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 25287us (25643us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788390424.951450:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390424.955929:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.956155:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093773312 00000100:00100000:3.0:1788390424.956165:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093773312 00000100:00100000:3.0:1788390424.956255:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390424.956266:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:10457:x1875263093773312:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788390424.956496:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10457:x1875263093773312:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 232us (575us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788390424.956504:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390424.961069:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390424.961178:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093773568 00000100:00100000:0.0:1788390424.961187:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093773568 00000100:00100000:0.0:1788390424.961242:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788390424.961252:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10457:x1875263093773568:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788390424.961357:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10457:x1875263093773568:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390424.961365:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1788390424.965238:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.968503:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093773696 00000100:00100000:3.0:1788390424.968519:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093773696 00000100:00100000:3.0:1788390424.968582:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788390424.968594:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10457:x1875263093773696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390424.968698:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390424.968721:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebaa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.968790:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.968804:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.968816:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390424.968926:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390424.968943:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.968988:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebaa expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.969008:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebaa expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.969017:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390424.969020:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788390424.969024:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390424.969085:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10457:x1875263093773696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 493us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390424.969092:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788390424.974056:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.974281:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093773824 00000100:00100000:1.0:1788390424.974291:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093773824 00000100:00100000:1.0:1788390424.974450:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788390424.974461:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093773824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390424.974487:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390424.974509:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebb1 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390424.974536:0:8777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac19, blocks: 0x1 00010000:00010000:1.0:1788390424.974554:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=242s v=(0 0) 00010000:00010000:1.0:1788390424.974559:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390424.974567:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 6 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.974593:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 6 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390424.974607:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390424.974938:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2358:x1875263093773824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 478us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.974946:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000040:00080000:2.0:1788390424.979024:0:11958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390424.979034:0:11958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390424.979071:0:11958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788390424.979077:0:11958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390424.981599:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390424.981703:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774080 00000100:00100000:1.0:1788390424.981712:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774080 00000100:00100000:1.0:1788390424.982158:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788390424.982171:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10457:x1875263093774080:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390424.982283:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10457:x1875263093774080:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 116us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390424.982291:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1788390424.989007:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390424.989938:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774208 00000100:00100000:3.0:1788390424.989948:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774208 00000100:00100000:3.0:1788390424.990019:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788390424.990030:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:10457:x1875263093774208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390424.990047:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390424.990068:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebb8 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.990095:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.990104:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390424.990107:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390424.990112:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.990142:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390424.990156:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390424.990170:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103229952:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390424.990250:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390425.002443:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103229952:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390425.002497:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.002520:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390425.004702:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:10457:x1875263093774208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 14663us (15692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.004722:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390425.004899:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390425.005072:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774336 00000100:00100000:3.0:1788390425.005080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774336 00010000:00010000:3.0:1788390425.005113:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.005148:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788390425.005158:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093774336:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390425.005170:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390425.005196:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.005211:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.005234:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb1 expref: 7 pid: 8777 timeout: 342 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.005246:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390425.005273:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390425.005282:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.005293:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.005326:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.005352:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1875263103230080:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390425.005414:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390425.013208:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1875263103230080:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788390425.013231:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390425.013285:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093774336:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8128us (8385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390425.013308:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1788390425.017260:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390425.017323:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774464 00000100:00100000:0.0:1788390425.017332:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774464 00002000:00100000:0.0:1788390425.017386:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff95d6bcb2fb80 x1875263093774464/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:41/0 lens 504/0 e 0 to 0 dl 1788390436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390425.017395:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bcb2fb80 with x1875263093774464 ext(0->8) 00002000:00010000:0.0:1788390425.017399:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bcb2fb80 00000100:00100000:0.0:1788390425.017424:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390425.017434:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093774464:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788390425.018290:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093774464:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 854us (1035us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788390425.018302:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:2.0:1788390425.018309:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff95d6bcb2fb80 x1875263093774464/t4294967302(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:41/0 lens 504/448 e 0 to 0 dl 1788390436 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788390425.018323:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bcb2fb80 with x1875263093774464 ext(0->8) 00002000:00010000:2.0:1788390425.018339:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bcb2fb80 00000100:00100000:2.0:1788390425.020412:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390425.020456:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774592 00000100:00100000:3.0:1788390425.020466:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774592 00000100:00100000:3.0:1788390425.020547:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788390425.020559:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10457:x1875263093774592:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788390425.020596:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390425.038083:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390425.038114:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103230208:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.038184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390425.038232:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103230720:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.038259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390425.038305:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230208 00000100:00100000:2.0:1788390425.038314:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230208 00000100:00100000:2.0:1788390425.038360:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788390425.038371:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103230208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390425.038434:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3287:x1875263103230208:12345-0@lo:400:kworker.0 Request processed in 65us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390425.038442:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788390425.038878:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103230592:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.038924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390425.038987:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103230336:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039015:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390425.039052:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103230848:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039082:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390425.039105:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230592 00000100:00100000:3.0:1788390425.039107:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390425.039113:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230592 00000100:00100000:3.0:1788390425.039116:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103230464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039141:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390425.039152:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390425.039169:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230848 00000100:00100000:1.0:1788390425.039174:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230848 00000100:00100000:0.0:1788390425.039174:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390425.039175:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230720 00000100:00100000:3.0:1788390425.039181:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230720 00000100:00100000:0.0:1788390425.039187:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103230592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039208:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230336 00000100:00100000:3.0:1788390425.039212:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230336 00000100:00100000:1.0:1788390425.039215:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390425.039227:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103230848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039229:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230464 00000100:00100000:3.0:1788390425.039233:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230464 00000100:00100000:0.0:1788390425.039237:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103230592:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390425.039247:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390425.039249:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788390425.039256:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103230720:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390425.039265:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390425.039269:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390425.039295:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103230848:12345-0@lo:400:kworker.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390425.039299:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103230592:0@lo:400:kworker.0 00000100:00100000:1.0:1788390425.039306:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788390425.039667:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103230720:12345-0@lo:400:kworker.0 Request processed in 410us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.039675:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788390425.039693:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390425.039699:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103230336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039730:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103230336:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.039735:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390425.039747:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390425.039752:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103230464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.039779:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103230464:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.039786:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390425.040031:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103230464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.040050:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103230336:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.040061:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103230848:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.040087:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103230720:0@lo:400:kworker.0 00000100:00100000:3.0:1788390425.040097:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3287:1875263103230208:0@lo:400:kworker.0 00000001:00080000:0.0:1788390425.041716:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000001:00080000:0.0:1788390425.041739:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1788390425.041745:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788390425.041814:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788390425.041835:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a26c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788390425.041840:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68a617500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a269c0 00000020:00080000:0.0:1788390425.041844:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68a617100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d69fc50400 00000001:00080000:0.0:1788390425.041875:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000100:00100000:3.0:1788390425.041950:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10457:x1875263093774592:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 21388us (21540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.041980:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000020:00080000:0.0:1788390425.042020:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1788390425.042121:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1788390425.042135:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788390425.042136:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103231104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788390425.042148:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103230976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390425.042182:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390425.042206:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103231104 00000100:00100000:0.0:1788390425.042213:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103231104 00000100:00100000:0.0:1788390425.042258:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390425.042268:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103231104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788390425.042406:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788390425.042410:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788390425 00002000:00010000:0.0:1788390425.042412:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390425.042414:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788390425 -> 1788390425 00002000:00010000:0.0:1788390425.042417:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788390425.042463:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103231104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (280us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788390425.042486:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1788390425.042501:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d682f2b100/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788390425.042508:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103231104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788390425.042518:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390425.042547:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103230976 00000100:00100000:3.0:1788390425.042552:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103230976 00000100:00100000:3.0:1788390425.042589:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390425.042597:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103230976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788390425.042622:0:6652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788390425.042649:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a98ac17, atime: 0x6a98ac17, ctime: 0x6a98ac17, blocks: 0x1 00010000:00010000:3.0:1788390425.042657:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.042672:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=242s v=(0 0) 00010000:00010000:3.0:1788390425.042676:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390425.042682:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.042706:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.042772:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.042782:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.042805:0:6652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390425.042995:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390425.043003:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.043013:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390425.043018:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.043027:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.043045:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.043064:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c6351b/0x9aafc5f04cd3228e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.043082:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390425.043084:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390425.043086:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390425.043439:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103230976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 842us (923us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788390425.043445:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788390425.044006:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc7cbb80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788390425.044014:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103230976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390425.044189:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390425.044228:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774720 00000100:00100000:0.0:1788390425.044235:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774720 00000100:00100000:0.0:1788390425.044282:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390425.044292:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093774720:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390425.084978:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788390425.084996:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788390425.085241:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093774720:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 40943us (41048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390425.085253:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390425.092410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390425.092471:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093774976 00000100:00100000:1.0:1788390425.092495:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093774976 00000100:00100000:1.0:1788390425.092554:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788390425.092564:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10457:x1875263093774976:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390425.092614:0:8163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390425.092642:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebaa expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.092661:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390425.092666:0:8163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390425.092697:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.092712:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.092722:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390425.093032:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091cee7e5 reply state 00000000338eecef transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390425.093042:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390425.093134:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:10457:x1875263093774976:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 571us (734us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788390425.093148:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:1.0:1788390425.098287:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098304:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098313:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098319:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390425.098324:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098331:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098348:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390425.098351:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390425.098356:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.098362:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32295 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.100350:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390425.100501:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093775104 00000100:00100000:2.0:1788390425.100511:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093775104 00000100:00100000:2.0:1788390425.100605:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788390425.100618:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093775104:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390425.100842:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788390425.100845:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788390425 -> 1788390424 00002000:00010000:2.0:1788390425.100847:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788390423 00002000:00010000:2.0:1788390425.100848:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788390425 -> 1788390424 00002000:00010000:2.0:1788390425.100850:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788390425.100901:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093775104:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 288us (562us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788390425.100906:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788390425.102942:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390425.103045:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093775360 00000100:00100000:3.0:1788390425.103054:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093775360 00000100:00100000:3.0:1788390425.103106:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788390425.103116:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10457:x1875263093775360:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788390425.103179:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.103196:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.103220:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.103255:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.103269:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 14 pid: 5807 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.103283:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103231232:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390425.103369:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390425.105808:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103231232:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390425.105901:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.112144:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390425.112546:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093775488 00000100:00100000:1.0:1788390425.112558:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093775488 00010000:00010000:1.0:1788390425.112601:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 15 pid: 5807 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390425.112640:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788390425.112659:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2357:x1875263093775488:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390425.112675:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390425.112683:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 15 pid: 5807 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112698:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 15 pid: 5807 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112720:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb9c expref: 15 pid: 5807 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112734:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390425.112739:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112749:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112756:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.112780:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390425.112996:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113004:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113034:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113042:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113060:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113066:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390425.113071:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113079:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113089:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390425.113092:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788390425.113096:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.113102:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd3229c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.113158:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10457:x1875263093775360:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 10043us (10222us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788390425.113167:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788390425.113539:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2357:x1875263093775488:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 881us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390425.113547:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788390425.123337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390425.123425:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093775616 00000100:00100000:3.0:1788390425.123436:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093775616 00000100:00100000:3.0:1788390425.123504:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1788390425.123516:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093775616:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788390425.123558:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.123577:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.123594:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390425.123598:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390425.123603:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.123643:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.123657:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 7 pid: 6653 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.123672:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103231360:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390425.123752:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390425.127856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390425.127895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093775744 00000100:00100000:1.0:1788390425.127905:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093775744 00010000:00010000:1.0:1788390425.127944:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 8 pid: 6653 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.128012:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103231360:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390425.128036:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390425.128091:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788390425.128102:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093775744:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390425.128119:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390425.128142:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 8 pid: 6653 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.128155:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 8 pid: 6653 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.128176:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd32287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebb8 expref: 8 pid: 6653 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.128193:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390425.128197:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390425.128202:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.128212:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.128240:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390425.128292:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093775744:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 192us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390425.128299:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:3.0:1788390425.129170:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129183:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129209:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129222:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129231:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129239:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390425.129243:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129251:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129265:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.129271:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd322a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.129537:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093775616:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 6020us (6208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.129547:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788390425.131829:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390425.131866:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776000 00000100:00100000:0.0:1788390425.131875:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776000 00000100:00100000:0.0:1788390425.131926:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788390425.131936:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:10457:x1875263093776000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390425.132040:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132059:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132073:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132264:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132275:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132284:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132316:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390425.132568:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 14 pid: 5805 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390425.132586:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103231488:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390425.132657:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390425.138991:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390425.139595:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776128 00000100:00100000:3.0:1788390425.139606:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776128 00010000:00010000:3.0:1788390425.139646:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 15 pid: 5805 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.139700:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1788390425.139711:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2356:x1875263093776128:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390425.139726:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390425.139734:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 15 pid: 5805 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.139747:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 15 pid: 5805 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.139768:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390425.139773:0:11126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.139782:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.139789:0:11126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.139810:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390425.140164:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2356:x1875263093776128:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 454us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390425.140173:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00010000:00010000:1.0:1788390425.140768:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeba3 expref: 14 pid: 5805 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390425.140785:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103231488:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390425.140807:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.140816:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.141274:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390425.141651:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967355 00000001:00080000:1.0:1788390425.141809:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788390425.143015:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000100:00100000:1.0:1788390425.143137:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103231616:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788390425.143209:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390425.143237:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390425.143497:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103231616 00000100:00100000:2.0:1788390425.143504:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103231616 00000100:00100000:2.0:1788390425.143549:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390425.143557:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8163:x1875263103231616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788390425.144840:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8163:x1875263103231616:12345-0@lo:1000:mdt00_003.0 Request processed in 1276us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390425.144853:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390425.144930:0:8163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788390425.144937:0:8163:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d682f2b100, transno 4294967303 00000100:00100000:3.0:1788390425.144958:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103231616:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788390425.146565:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788390425.146651:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103231744:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788390425.146723:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390425.146760:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390425.146824:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103231744 00000100:00100000:2.0:1788390425.146831:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103231744 00000100:00100000:2.0:1788390425.146886:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390425.146896:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8163:x1875263103231744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788390425.147156:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8163:x1875263103231744:12345-0@lo:1000:mdt00_003.0 Request processed in 261us (432us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788390425.147165:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390425.147188:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd14700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103231744:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788390425.147224:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147234:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147241:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147248:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390425.147253:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147260:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147277:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390425.147280:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390425.147284:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147290:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd322b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147325:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147532:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147538:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147543:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390425.147547:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147554:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147563:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:3.0:1788390425.147565:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390425.147568:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147574:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd321df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147595:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147608:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147618:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147644:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.147664:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 17 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.147677:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103231872:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390425.147742:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390425.150197:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103231872:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390425.150225:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390425.151163:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390425.151523:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776256 00000100:00100000:1.0:1788390425.151533:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776256 00010000:00010000:1.0:1788390425.151574:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 18 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390425.151657:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788390425.151669:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:2356:x1875263093776256:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390425.151686:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390425.151694:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 18 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151726:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 18 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151749:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd321fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb87 expref: 18 pid: 5806 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151765:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:1.0:1788390425.151771:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151780:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151787:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.151863:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390425.151923:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:2356:x1875263093776256:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 255us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390425.151931:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00010000:00010000:3.0:1788390425.152089:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152097:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152109:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152116:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152123:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152128:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390425.152132:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152139:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152157:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:3.0:1788390425.152159:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390425.152162:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152168:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152179:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152184:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152189:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152194:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390425.152196:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152202:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152208:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:3.0:1788390425.152211:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390425.152213:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390425.152218:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd322aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390425.152615:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:10457:x1875263093776000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 20679us (20806us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1788390425.152624:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000020:00080000:3.0:1788390425.152628:0:8163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788390425.152774:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390425.152785:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390425.152884:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788390425.152892:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390425.156512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390425.156663:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776512 00000100:00100000:1.0:1788390425.156673:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776512 00000100:00100000:1.0:1788390425.156744:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390425.156754:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:10457:x1875263093776512:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788390425.157433:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788390425.157555:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00010000:00010000:1.0:1788390425.157621:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157644:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157656:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157666:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157672:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157678:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390425.157700:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390425.157792:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10457:x1875263093776512:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1037us (1287us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1788390425.157801:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000020:00080000:1.0:1788390425.157812:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788390425.158679:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390425.158688:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.158697:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390425.158701:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.158709:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.158724:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff95d683b5a100) 00010000:00010000:2.0:1788390425.158727:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788390425.158731:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.158737:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd322bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390425.158757:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390425.158768:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390425.158770:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390425.549279:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390425.551106:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103232000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390425.551206:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390425.551336:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103232000 00000100:00100000:2.0:1788390425.551345:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103232000 00000100:00100000:2.0:1788390425.551400:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390425.551410:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103232000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390425.551444:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390425.551504:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103232000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390425.551512:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788390425.551601:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103232000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788390426.061132:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390426.545875:0:12011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390426.545884:0:12011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390426.546483:0:12011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788390426.546491:0:12011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390426.610094:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.610168:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776640 00000100:00100000:3.0:1788390426.610177:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776640 00000100:00100000:3.0:1788390426.610239:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390426.610251:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10475:x1875263093776640:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788390426.610344:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610362:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610373:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610389:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610397:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610556:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610796:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610811:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610819:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390426.610862:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610876:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610882:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610889:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610896:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390426.610900:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610908:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610921:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390426.610924:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390426.610929:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610935:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd322c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610952:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610986:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610994:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.610999:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390426.611002:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611009:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611017:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d6a704c200) 00010000:00010000:3.0:1788390426.611019:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390426.611022:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611028:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd322cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611043:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611049:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611055:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611066:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390426.611069:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611075:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611083:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:3.0:1788390426.611085:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390426.611088:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.611094:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd322d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390426.611175:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10475:x1875263093776640:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 925us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390426.611184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390426.641124:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.648223:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093776896 00000100:00100000:0.0:1788390426.648235:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093776896 00000100:00100000:0.0:1788390426.648299:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1788390426.648377:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10478:x1875263093776896:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390426.648495:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390426.648517:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd322db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebbf expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648588:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648603:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648614:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648629:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648648:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648655:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648902:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648911:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.648919:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390426.648929:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788390426.649041:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649049:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649056:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649063:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390426.649067:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649075:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649096:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390426.649099:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390426.649104:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649111:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd322e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649121:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649128:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649134:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649139:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390426.649142:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649147:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649155:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d684d23400) 00010000:00010000:0.0:1788390426.649157:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390426.649159:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649165:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd322e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649213:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd322db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649231:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.649239:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390426.649241:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390426.649244:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb800, rc 0) 00000100:00100000:0.0:1788390426.652480:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10478:x1875263093776896:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 998us (8191us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788390426.652497:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788390426.658583:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390426.658631:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093777024 00000100:00100000:2.0:1788390426.658640:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093777024 00000100:00100000:2.0:1788390426.658695:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1788390426.658706:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10478:x1875263093777024:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1788390426.658771:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658787:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658800:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658827:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658835:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658850:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658856:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390426.658861:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658869:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658881:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:2.0:1788390426.658884:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390426.658888:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.658895:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd322fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390426.658980:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10478:x1875263093777024:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 255us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390426.658989:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788390426.668573:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.668611:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093777280 00000100:00100000:0.0:1788390426.668620:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093777280 00000100:00100000:0.0:1788390426.668674:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390426.668685:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10478:x1875263093777280:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390426.668894:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10478:x1875263093777280:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 211us (330us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788390426.668902:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390426.697766:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.697869:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093777536 00000100:00100000:1.0:1788390426.697881:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093777536 00000100:00100000:1.0:1788390426.698108:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1788390426.698120:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10000:x1875263093777536:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390426.698148:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390426.698171:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32305 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebc6 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.698267:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.698294:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.698303:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.698345:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.698359:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 22 pid: 5806 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390426.698382:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103232128:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390426.698611:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390426.700528:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103232128:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390426.700558:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390426.700945:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.701095:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093777664 00000100:00100000:0.0:1788390426.701102:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093777664 00010000:00010000:0.0:1788390426.701144:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 23 pid: 5806 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.701183:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788390426.701206:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:2357:x1875263093777664:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390426.701220:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390426.701227:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 23 pid: 5806 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701239:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 23 pid: 5806 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701261:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd322f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebbf expref: 23 pid: 5806 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701276:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390426.701281:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701291:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701299:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.701329:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390426.701503:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:2357:x1875263093777664:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 298us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390426.701511:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00010000:00010000:1.0:1788390426.701598:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.701605:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390426.701623:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788390426.701757:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32305 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 23 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.701783:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 22 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.701790:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390426.701793:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390426.701795:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390426.701819:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:10000:x1875263093777536:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3703us (4065us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788390426.701825:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788390426.706012:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.706159:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093777920 00000100:00100000:0.0:1788390426.706169:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093777920 00000100:00100000:0.0:1788390426.706264:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788390426.706276:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:10000:x1875263093777920:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1788390426.706556:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.706573:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.706585:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390426.706635:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967365 00000004:00010000:0.0:1788390426.706657:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000536971e5 reply state 0000000080759666 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.706666:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788390426.706711:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967366 00000100:00100000:0.0:1788390426.706810:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10000:x1875263093777920:12345-192.168.202.1@tcp:36:bash.0 Request processed in 535us (807us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788390426.706818:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000020:00080000:0.0:1788390426.706823:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788390426.708709:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708725:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708732:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708738:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.708742:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708749:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708766:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390426.708769:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.708773:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.708790:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3231a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390426.708846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.708946:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778048 00000100:00100000:0.0:1788390426.708955:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778048 00000100:00100000:0.0:1788390426.709023:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788390426.709033:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:10000:x1875263093778048:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390426.709056:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390426.709076:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebcd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.709127:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebcd expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.709153:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebcd expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.709173:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390426.709175:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390426.709178:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb600, rc 0) 00000100:00100000:0.0:1788390426.709314:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10000:x1875263093778048:12345-192.168.202.1@tcp:101:bash.0 Request processed in 281us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390426.709321:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788390426.715237:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.715328:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778176 00000100:00100000:1.0:1788390426.715337:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778176 00000100:00100000:1.0:1788390426.715453:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788390426.715475:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:10000:x1875263093778176:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390426.715491:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390426.715512:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebd4 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390426.715539:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a98ac18, atime: 0x6a98ac17, ctime: 0x6a98ac18, blocks: 0xb 00010000:00010000:1.0:1788390426.715560:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=243s v=(0 0) 00010000:00010000:1.0:1788390426.715564:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390426.715572:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.715589:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 7 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.715601:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390426.715662:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:10000:x1875263093778176:12345-192.168.202.1@tcp:101:bash.0 Request processed in 200us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390426.715669:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00080000:0.0:1788390426.716181:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390426.717792:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.717876:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778304 00000100:00100000:1.0:1788390426.717885:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778304 00002000:00010000:1.0:1788390426.717930:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788390426.717935:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fd03480 with x1875263093778304 ext(0->18446744073709551615) 00002000:00010000:1.0:1788390426.717946:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fd03480. 00000100:00100000:1.0:1788390426.718046:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390426.718057:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093778304:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:1.0:1788390426.718333:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788390426.718337:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788390424 -> 1788390426 00002000:00010000:1.0:1788390426.718340:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788390423 -> 1788390423 00002000:00010000:1.0:1788390426.718342:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788390424 -> 1788390426 00002000:00010000:1.0:1788390426.718345:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788390426.718414:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093778304:12345-192.168.202.1@tcp:10:bash.0 Request processed in 358us (627us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788390426.718422:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00010000:1.0:1788390426.718426:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788390426.718429:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fd03480 with x1875263093778304 ext(0->18446744073709551615) 00002000:00010000:1.0:1788390426.718434:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fd03480. 00000100:00100000:3.0:1788390426.741906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.741953:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.742032:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390426.742118:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778432 00000100:00100000:2.0:1788390426.742129:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778432 00000100:00100000:2.0:1788390426.742192:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:2.0:1788390426.742218:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2359:x1875263093778432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390426.742290:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2359:x1875263093778432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390426.742298:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:1.0:1788390426.742567:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778560 00000100:00100000:1.0:1788390426.742572:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778560 00000100:00100000:0.0:1788390426.742695:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778688 00000100:00100000:0.0:1788390426.742700:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778688 00000100:00100000:1.0:1788390426.742719:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788390426.742833:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2359:x1875263093778560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390426.742883:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2359:x1875263093778560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 156us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390426.742891:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00080000:3.0:1788390426.743582:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390426.743588:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390426.749105:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1788390426.749126:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093778688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390426.749236:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2359:x1875263093778688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 118us (7281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390426.749244:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1788390426.783252:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.783507:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093778816 00000100:00100000:1.0:1788390426.783517:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093778816 00000100:00100000:1.0:1788390426.783620:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390426.783631:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10492:x1875263093778816:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788390426.783704:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.783721:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.783733:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.783749:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.783757:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.783764:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784005:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784014:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784031:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390426.784068:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784080:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784087:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784095:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784100:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.784104:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784113:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784125:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390426.784128:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.784133:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784139:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3232f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784150:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784162:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784168:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784173:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.784176:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784181:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784189:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ad00) 00010000:00010000:1.0:1788390426.784191:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.784194:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784200:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784217:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784223:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784229:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784234:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.784241:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784248:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784255:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390426.784258:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.784261:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.784267:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3233d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390426.784348:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10492:x1875263093778816:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 718us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390426.784356:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788390426.817708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390426.817818:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093779072 00000100:00100000:2.0:1788390426.817829:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093779072 00000100:00100000:2.0:1788390426.817889:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788390426.817900:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10495:x1875263093779072:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390426.817920:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390426.817942:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebdb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818059:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818074:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818085:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818099:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818107:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818114:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818376:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818387:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818394:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390426.818807:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788390426.818899:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818908:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818915:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818922:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390426.818926:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.818934:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819008:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390426.819012:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390426.819017:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819084:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd3234b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819099:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819104:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819110:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819115:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390426.819118:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819124:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819133:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d68641eb00) 00010000:00010000:2.0:1788390426.819135:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390426.819138:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819144:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819187:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebdb expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819201:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebdb expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.819215:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:2.0:1788390426.819217:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788390426.819220:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:2.0:1788390426.819336:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10495:x1875263093779072:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1437us (1637us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788390426.819344:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788390426.821802:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.821882:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093779200 00000100:00100000:0.0:1788390426.821892:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093779200 00000100:00100000:0.0:1788390426.822034:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788390426.822046:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10495:x1875263093779200:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1788390426.822109:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.822127:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.822136:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.822168:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.822200:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 28 pid: 8163 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.822215:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103232256:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390426.822649:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390426.825901:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.826016:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103232256:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390426.826047:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390426.827234:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093779456 00000100:00100000:1.0:1788390426.827245:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093779456 00000100:00100000:1.0:1788390426.827679:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390426.827692:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:5588:x1875263093779456:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390426.828020:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:5588:x1875263093779456:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 330us (2131us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788390426.828029:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390426.832692:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.832790:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093779584 00000100:00100000:0.0:1788390426.832800:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093779584 00010000:00010000:0.0:1788390426.832840:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 30 pid: 8163 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.832882:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1788390426.832892:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:2356:x1875263093779584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390426.832907:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390426.832913:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 30 pid: 8163 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.832926:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 30 pid: 8163 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.832948:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3230c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebc6 expref: 30 pid: 8163 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.833038:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390426.833044:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.833066:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.833074:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.833104:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390426.833215:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833224:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833251:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833258:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833265:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833271:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390426.833275:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833282:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833292:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:3.0:1788390426.833295:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390426.833298:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.833304:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.833373:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:2356:x1875263093779584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 473us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390426.833381:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390426.833867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10495:x1875263093779200:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 11821us (12070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390426.833876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788390426.836772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.836951:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093779840 00000100:00100000:3.0:1788390426.836991:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093779840 00000100:00100000:3.0:1788390426.837040:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390426.837050:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:10495:x1875263093779840:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390426.837309:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:10495:x1875263093779840:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 259us (545us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788390426.837326:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390426.905519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.905682:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093780096 00000100:00100000:1.0:1788390426.905693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093780096 00000100:00100000:1.0:1788390426.905760:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788390426.905770:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:10506:x1875263093780096:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1788390426.905794:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390426.905827:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3236e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebe2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905898:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905912:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905925:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905940:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905947:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.905954:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.906246:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.906255:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.906263:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390426.906272:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788390426.906352:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907124:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907131:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907137:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.907141:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907149:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907163:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390426.907166:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.907171:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907176:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32375 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907189:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907195:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907201:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907206:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.907216:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907223:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907231:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ad00) 00010000:00010000:1.0:1788390426.907233:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.907236:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.907242:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3237c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.907553:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3236e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe2 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.907571:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe2 expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.907579:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:2.0:1788390426.907581:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390426.907584:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:2.0:1788390426.908050:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:10506:x1875263093780096:12345-192.168.202.1@tcp:101:cat.0 Request processed in 2279us (2539us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788390426.908059:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1788390426.911768:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.911954:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093780352 00000100:00100000:0.0:1788390426.914207:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093780352 00000100:00100000:0.0:1788390426.914339:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390426.914350:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:10506:x1875263093780352:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:0.0:1788390426.914994:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:10506:x1875263093780352:12345-192.168.202.1@tcp:35:cat.0 Request processed in 644us (3233us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788390426.915003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788390426.940156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390426.940264:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093780608 00000100:00100000:1.0:1788390426.940274:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093780608 00000100:00100000:1.0:1788390426.940385:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788390426.940406:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:10507:x1875263093780608:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:1.0:1788390426.940480:0:8163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788390426.940511:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe2 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940533:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebdb expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940545:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebcd expref: 30 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940556:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390426.940579:0:8163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390426.940599:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940623:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940633:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940648:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940655:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.940660:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.941373:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.941383:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.941391:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390426.942514:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788390426.942526:0:8163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 244049564195ns, next at 245049561595ns, rc = 0 00010000:00010000:1.0:1788390426.942594:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942628:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942638:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942645:0:8163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942652:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942659:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942822:0:8163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390426.942846:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942853:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942859:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942864:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.942868:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942874:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942895:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5aa00) 00010000:00010000:1.0:1788390426.942897:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788390426.942902:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942907:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd3239f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942927:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942933:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942938:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942943:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.942945:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.942951:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.943131:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390426.943135:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.943139:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.943145:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390426.943165:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c19c6894 reply state 00000000ce49ed18 transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390426.943173:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390426.943386:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:10507:x1875263093780608:12345-192.168.202.1@tcp:36:rm.0 Request processed in 2987us (3236us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788390426.943395:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00010000:00010000:2.0:1788390426.943810:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390426.943818:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.943835:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390426.943839:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.943845:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.943855:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95d683b5aa00) 00010000:00010000:2.0:1788390426.943857:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788390426.943860:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.943865:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd323a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.943884:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390426.943886:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390426.943888:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390426.948658:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948676:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948683:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948690:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.948695:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948711:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948729:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ad00) 00010000:00010000:1.0:1788390426.948732:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.948736:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.948742:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32398 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390426.978159:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390426.978547:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093780864 00000100:00100000:0.0:1788390426.978558:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093780864 00000100:00100000:0.0:1788390426.978655:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788390426.978666:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:10513:x1875263093780864:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390426.978693:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390426.978726:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd323ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebe9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978843:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978875:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978886:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978903:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978910:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.978916:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390426.979718:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788390426.979859:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979869:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979877:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979908:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979915:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979921:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979951:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390426.979957:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.979993:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.980006:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390426.980009:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390426.980013:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.980019:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd323b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390426.980032:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ce672c4 reply state 0000000008f73a42 transno 4294967374 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390426.980041:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390426.980069:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd323ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.980082:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390426.980090:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390426.980093:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390426.980095:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa000, rc 0) 00000100:00100000:0.0:1788390426.980168:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10513:x1875263093780864:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1502us (2017us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788390426.980181:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788390426.983131:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390426.983237:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093780992 00000100:00100000:2.0:1788390426.983247:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093780992 00000100:00100000:2.0:1788390426.983306:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788390426.983327:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093780992:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390426.983345:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390426.983372:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebf0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390426.983408:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390426.983428:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=244s v=(0 0) 00010000:00010000:2.0:1788390426.983442:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390426.983452:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.983483:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 8 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.983496:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:2.0:1788390426.983553:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2358:x1875263093780992:12345-192.168.202.1@tcp:101:bash.0 Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390426.983560:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390426.986212:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390426.989884:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093781120 00000100:00100000:2.0:1788390426.989899:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093781120 00000100:00100000:2.0:1788390426.989991:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788390426.990003:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:10513:x1875263093781120:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390426.990021:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390426.990042:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebf7 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.990075:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.990084:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390426.990088:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390426.990093:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.990147:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390426.990161:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390426.990176:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103232384:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390426.990276:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6878660c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390426.991017:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991028:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991035:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991040:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390426.991044:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991051:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991066:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d684d23400) 00010000:00010000:1.0:1788390426.991068:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390426.991072:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390426.991077:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd323bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390426.992932:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103232384:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390426.992992:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.993011:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:3.0:1788390426.993060:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:10513:x1875263093781120:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3059us (6856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390426.993069:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788390426.994381:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390426.994547:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093781248 00000100:00100000:3.0:1788390426.994556:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093781248 00010000:00010000:3.0:1788390426.994592:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390426.994712:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788390426.994722:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093781248:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390426.994734:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390426.994755:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.994768:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.994790:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd323d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf0 expref: 9 pid: 6652 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.994803:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390426.994807:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390426.994815:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.994825:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390426.994858:0:11126:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390426.994872:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11126:1875263103232512:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390426.994941:0:11126:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390426.999865:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390427.000252:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093781504 00000100:00100000:0.0:1788390427.000261:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093781504 00000100:00100000:0.0:1788390427.000412:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390427.000426:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:10513:x1875263093781504:12345-192.168.202.1@tcp:35:bash.0 00000100:00080000:1.0:1788390427.000539:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390427.000954:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10513:x1875263093781504:12345-192.168.202.1@tcp:35:bash.0 Request processed in 531us (1098us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788390427.000996:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390427.001776:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11126:1875263103232512:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788390427.001799:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390427.001849:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093781248:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 7127us (7471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.001858:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00010000:00010000:2.0:1788390427.085321:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390427.085387:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390427.085418:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390427.085499:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.085786:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103232640 00000100:00100000:2.0:1788390427.085794:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103232640 00000100:00100000:2.0:1788390427.085861:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390427.085872:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103232640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390427.085905:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390427.085986:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103232640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.085993:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788390427.086601:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390427.086684:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390427.129389:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.129563:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093781632 00000100:00100000:3.0:1788390427.129574:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093781632 00000100:00100000:3.0:1788390427.129634:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788390427.129644:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:10529:x1875263093781632:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390427.129668:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390427.129690:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd323de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfebfe expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129755:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129769:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129780:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390427.129813:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788390427.129828:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390427.129850:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129875:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd323de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebfe expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129900:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebfe expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.129909:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390427.129912:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390427.129916:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:3.0:1788390427.130022:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:10529:x1875263093781632:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 378us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.130029:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788390427.137567:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.137663:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093781888 00000100:00100000:2.0:1788390427.137673:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093781888 00000100:00100000:2.0:1788390427.137741:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788390427.137752:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:10529:x1875263093781888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390427.137773:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.137795:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd323ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec05 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.137917:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd323f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.137931:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd323f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.137942:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd323f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390427.137952:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788390427.138109:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd323ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec05 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.138128:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd323f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec05 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.138138:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:2.0:1788390427.138141:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390427.138145:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:2.0:1788390427.138209:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:10529:x1875263093781888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 459us (661us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788390427.138217:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788390427.141583:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.141630:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.141805:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782016 00000100:00100000:1.0:1788390427.141828:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782016 00000100:00100000:1.0:1788390427.141896:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390427.141907:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:2357:x1875263093782016:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390427.141922:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390427.141946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd323f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec05 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.141998:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390427.142003:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390427.142055:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:2357:x1875263093782016:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 151us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.142063:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390427.142437:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782272 00000100:00100000:3.0:1788390427.142443:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782272 00000100:00100000:3.0:1788390427.142490:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788390427.142499:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:10529:x1875263093782272:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390427.142519:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390427.142533:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32401 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec0c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.142634:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.142648:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.142669:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390427.142681:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788390427.142888:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32401 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec0c expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.142906:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec0c expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.142913:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390427.142916:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390427.142918:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390427.142952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:10529:x1875263093782272:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 455us (1322us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788390427.142987:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788390427.147123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.147195:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782400 00000100:00100000:1.0:1788390427.147206:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782400 00000100:00100000:1.0:1788390427.147268:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390427.147279:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093782400:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:1.0:1788390427.147324:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.147345:0:6652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.147355:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390427.147359:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390427.147374:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.147429:0:6652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.147443:0:6652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 8 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390427.147471:0:6652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875263103232768:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390427.147580:0:6652:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390427.151136:0:6652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6652:1875263103232768:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390427.151165:0:6652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.154405:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.155097:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782528 00000100:00100000:1.0:1788390427.155108:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782528 00002000:00100000:1.0:1788390427.155160:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff95d69fd00e00 x1875263093782528/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:43/0 lens 504/0 e 0 to 0 dl 1788390438 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390427.155171:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fd00e00 with x1875263093782528 ext(0->8) 00010000:00010000:1.0:1788390427.155180:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 9 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.155196:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 9 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390427.155203:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d69fd00e00 00000100:00100000:1.0:1788390427.155251:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390427.155261:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093782528:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1788390427.156514:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:2356:x1875263093782528:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1249us (2113us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788390427.156524:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:1.0:1788390427.156532:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff95d69fd00e00 x1875263093782528/t4294967302(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:43/0 lens 504/448 e 0 to 0 dl 1788390438 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390427.156542:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fd00e00 with x1875263093782528 ext(0->8) 00010000:00010000:1.0:1788390427.156549:0:6658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.156564:0:6658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390427.156571:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d69fd00e00 00000100:00100000:3.0:1788390427.167607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390427.167756:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782656 00000100:00100000:0.0:1788390427.167767:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782656 00010000:00010000:0.0:1788390427.167812:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390427.167858:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390427.167870:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:2357:x1875263093782656:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390427.167885:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788390427.167907:0:5792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788390427.167910:0:5792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788390427 00002000:00010000:0.0:1788390427.167913:0:5792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788390427 00002000:00010000:0.0:1788390427.167915:0:5792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788390427 00010000:00010000:0.0:1788390427.167922:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.167937:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.168014:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd323d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebf7 expref: 11 pid: 6650 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.168030:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390427.168034:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390427.168040:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.168050:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.168076:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390427.168135:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2357:x1875263093782656:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 267us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390427.168142:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00010000:00010000:1.0:1788390427.168488:0:6652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168499:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168525:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168534:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168551:0:6652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168558:0:6652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390427.168562:0:6652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168572:0:6652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168585:0:6652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.168592:0:6652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c718e1c/0x9aafc5f04cd32416 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390427.168659:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093782400:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 21380us (21544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.168667:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788390427.171279:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.171379:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093782912 00000100:00100000:2.0:1788390427.171388:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093782912 00000100:00100000:2.0:1788390427.171464:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788390427.171475:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:10529:x1875263093782912:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1788390427.171536:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec0c expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390427.171760:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967378 00000001:00080000:2.0:1788390427.171801:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000001:00080000:2.0:1788390427.172141:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00010000:00010000:2.0:1788390427.172193:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.172209:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.172218:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.172249:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.172263:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 41 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.172277:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103232896:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390427.172349:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687866f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390427.175503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.175588:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783040 00000100:00100000:1.0:1788390427.175597:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783040 00010000:00010000:1.0:1788390427.175636:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 42 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390427.175676:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788390427.175696:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:2356:x1875263093783040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390427.175711:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390427.175718:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 42 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.175732:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 42 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.175753:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390427.175758:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.175768:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.175775:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.175791:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390427.175841:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:2356:x1875263093783040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.175848:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:0.0:1788390427.183046:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd323c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebe9 expref: 41 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390427.183074:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103232896:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390427.183098:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.183110:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.183116:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390427.183260:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788390427.183471:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000100:00100000:0.0:1788390427.183587:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103233024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788390427.183655:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.183697:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390427.183799:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103233024 00000100:00100000:2.0:1788390427.183806:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103233024 00000100:00100000:2.0:1788390427.183883:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390427.183901:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5809:x1875263103233024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390427.184003:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5809:x1875263103233024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.184011:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788390427.184085:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390427.184169:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103233024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788390427.184605:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000100:00100000:0.0:1788390427.184661:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103233152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788390427.184694:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.184710:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390427.184776:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103233152 00000100:00100000:2.0:1788390427.184781:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103233152 00000100:00100000:2.0:1788390427.184817:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390427.184825:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5809:x1875263103233152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390427.185002:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5809:x1875263103233152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (307us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788390427.185010:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390427.185097:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103233152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788390427.185141:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788390427.185175:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185184:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185192:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185203:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390427.185207:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185214:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185230:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390427.185233:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788390427.185239:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.185245:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3241d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390427.185396:0:5809:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788390427.185506:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788390427.185517:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244292555446ns, next at 245292553518ns, rc = 0 00000001:00080000:3.0:1788390427.185524:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:3.0:1788390427.185553:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390427.185556:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390427.185563:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd32408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec0c expref: 45 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390427.185668:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+44:10529:x1875263093782912:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 14194us (14399us total) trans 4294967386 rc 0/0 00000100:00100000:3.0:1788390427.185677:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000020:00080000:3.0:1788390427.185681:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788390427.189817:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.189944:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783168 00000100:00100000:3.0:1788390427.190405:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783168 00000100:00100000:2.0:1788390427.190570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1788390427.190584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+44:10529:x1875263093783168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390427.190620:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.190662:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32424 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.190744:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32424 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec13 expref: 45 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.190761:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32424 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec13 expref: 45 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.190785:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390427.190788:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390427.190809:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93600, rc 0) 00000100:00100000:2.0:1788390427.190887:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+45:10529:x1875263093783168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 305us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.190894:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1788390427.194830:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.194894:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783424 00000100:00100000:1.0:1788390427.194909:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783424 00000100:00100000:1.0:1788390427.195003:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788390427.195016:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+45:10529:x1875263093783424:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390427.195552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10529:x1875263093783424:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 536us (734us total) trans 4294967387 rc 0/0 00000100:00100000:2.0:1788390427.195562:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390427.255898:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.257231:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783552 00000100:00100000:2.0:1788390427.257253:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783552 00000100:00100000:2.0:1788390427.257357:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1788390427.257370:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10539:x1875263093783552:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788390427.257489:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.257515:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.257924:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.257947:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.257956:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258000:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258129:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258158:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258165:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390427.258229:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258244:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258252:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258259:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258265:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390427.258271:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258280:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258295:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390427.258299:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390427.258304:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258310:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3242b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258334:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258340:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258347:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258352:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390427.258355:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258362:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258370:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d68641e000) 00010000:00010000:2.0:1788390427.258372:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390427.258375:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258381:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258398:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258404:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258410:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258420:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390427.258423:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258429:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258437:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390427.258439:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390427.258442:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.258448:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.258578:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10539:x1875263093783552:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1208us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.258589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788390427.289595:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390427.289729:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783808 00000100:00100000:0.0:1788390427.289743:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783808 00000100:00100000:0.0:1788390427.289822:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788390427.293609:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+46:10542:x1875263093783808:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390427.293648:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390427.293678:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32440 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec1a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293782:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293801:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293815:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293856:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293864:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.293870:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294049:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294059:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294067:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390427.294081:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788390427.294211:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294219:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294226:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294232:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390427.294237:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294256:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294270:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390427.294273:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390427.294279:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294286:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294302:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294308:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294314:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294319:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390427.294322:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294328:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294335:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d684d23600) 00010000:00010000:0.0:1788390427.294338:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390427.294341:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294360:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3244e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294409:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 49 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294424:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.294431:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390427.294433:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390427.294436:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb200, rc 0) 00000100:00100000:0.0:1788390427.294553:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:10542:x1875263093783808:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 987us (4971us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788390427.294562:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1788390427.301940:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.302040:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093783936 00000100:00100000:3.0:1788390427.302054:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093783936 00000100:00100000:3.0:1788390427.302139:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788390427.302153:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:10542:x1875263093783936:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390427.302248:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302269:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302282:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302328:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302336:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302343:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302349:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390427.302354:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302372:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302409:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390427.302413:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390427.302418:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.302424:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd32463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390427.302616:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:10542:x1875263093783936:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 464us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.302625:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788390427.304680:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390427.304802:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093784192 00000100:00100000:0.0:1788390427.304820:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093784192 00000100:00100000:0.0:1788390427.304907:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390427.304920:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:10542:x1875263093784192:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390427.305337:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10542:x1875263093784192:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 419us (671us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788390427.305346:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390427.365321:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.365421:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093784448 00000100:00100000:2.0:1788390427.365434:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093784448 00000100:00100000:2.0:1788390427.365523:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:2.0:1788390427.365537:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10552:x1875263093784448:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390427.365573:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.365577:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390427.365611:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd323e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebfe expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365640:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390427.365664:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390427.365682:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3246a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec21 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365821:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365837:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 49 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365847:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365889:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 49 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.365903:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 49 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.365920:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103233280:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390427.366587:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687866300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390427.369671:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103233280:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390427.369711:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390427.370655:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.372761:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093784576 00000100:00100000:1.0:1788390427.372807:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093784576 00010000:00010000:1.0:1788390427.372872:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 50 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390427.372920:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788390427.372933:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+50:2357:x1875263093784576:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390427.372955:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390427.372985:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 50 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373113:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 50 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373338:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec1a expref: 50 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373360:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390427.373366:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373377:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373385:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.373423:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390427.373507:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.373517:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390427.373553:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1788390427.373643:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:2357:x1875263093784576:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 710us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.373662:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00010000:00010000:2.0:1788390427.373759:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3246a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 50 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.373773:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 49 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.373779:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390427.373781:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390427.373783:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:2.0:1788390427.373806:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10552:x1875263093784448:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8274us (8502us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788390427.373811:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1788390427.381931:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.382333:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093784832 00000100:00100000:2.0:1788390427.382347:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093784832 00000100:00100000:2.0:1788390427.382438:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788390427.382450:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+49:10552:x1875263093784832:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1788390427.382830:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.382852:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.382867:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390427.382927:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00000004:00010000:2.0:1788390427.385173:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000950810d reply state 000000009ec51500 transno 4294967392 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.385197:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390427.385386:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10552:x1875263093784832:12345-192.168.202.1@tcp:36:bash.0 Request processed in 2931us (3462us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788390427.385396:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000020:00080000:2.0:1788390427.385403:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390427.390628:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390652:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390661:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390668:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390427.390673:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390681:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390702:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390427.390706:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390427.390712:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.390718:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3247f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390427.391324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390427.391409:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093784960 00000100:00100000:0.0:1788390427.391422:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093784960 00000100:00100000:0.0:1788390427.391518:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788390427.391530:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10552:x1875263093784960:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390427.391561:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390427.391585:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec28 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.391710:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.391729:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 52 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.391738:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.391788:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 52 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.391803:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 52 pid: 5807 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390427.391819:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103233408:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390427.391933:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390427.394645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.394761:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785088 00000100:00100000:1.0:1788390427.394775:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785088 00010000:00010000:1.0:1788390427.394824:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 53 pid: 5807 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390427.394826:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103233408:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390427.394859:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390427.394888:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788390427.394899:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:2356:x1875263093785088:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390427.394919:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390427.394927:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 53 pid: 5807 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.394941:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 53 pid: 5807 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.394996:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd32471 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec21 expref: 53 pid: 5807 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.395018:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390427.395024:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.395034:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.395042:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390427.395063:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390427.395142:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:2356:x1875263093785088:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 243us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.395150:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00010000:00010000:0.0:1788390427.395168:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.395182:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390427.395243:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788390427.395249:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390427.395275:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.395315:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.395332:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390427.395341:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390427.395344:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390427.395347:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:0.0:1788390427.395830:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10552:x1875263093784960:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4299us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390427.395839:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1788390427.402681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.402865:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785344 00000100:00100000:2.0:1788390427.402879:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785344 00000100:00100000:2.0:1788390427.403042:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390427.403162:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:10552:x1875263093785344:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788390427.403609:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10552:x1875263093785344:12345-192.168.202.1@tcp:35:bash.0 Request processed in 555us (941us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788390427.403619:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788390427.448594:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.448674:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785472 00000100:00100000:2.0:1788390427.448689:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785472 00000100:00100000:2.0:1788390427.448830:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1788390427.448846:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:10558:x1875263093785472:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390427.448880:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.449129:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec2f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449264:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449281:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449292:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390427.449330:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788390427.449333:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390427.449350:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449372:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec2f expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449408:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec2f expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.449415:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390427.449417:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390427.449420:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390427.449560:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093785472:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 719us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.449567:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390427.451886:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.452028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785600 00000100:00100000:2.0:1788390427.452042:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785600 00000100:00100000:2.0:1788390427.452364:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788390427.452375:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093785600:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390427.452399:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.452434:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd324a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec36 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452526:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452543:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452556:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452572:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452578:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452585:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452694:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452708:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390427.452765:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788390427.452770:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390427.452792:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452812:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452821:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452827:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452834:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452840:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390427.452845:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452853:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452866:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390427.452870:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390427.452875:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452881:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd324a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452907:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452913:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452925:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452930:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390427.452933:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452939:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452948:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d68641e000) 00010000:00010000:2.0:1788390427.452950:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390427.452953:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.452991:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.453030:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd324a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec36 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.453044:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec36 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.453052:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390427.453054:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390427.453407:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:2.0:1788390427.453554:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10558:x1875263093785600:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1179us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.453569:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1788390427.459860:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390427.459909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.460344:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785728 00000100:00100000:3.0:1788390427.460358:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785728 00000100:00100000:3.0:1788390427.460444:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390427.460467:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:2356:x1875263093785728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390427.460487:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390427.460518:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd324b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec36 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.460544:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390427.460550:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390427.460633:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:2356:x1875263093785728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 178us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.460641:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788390427.463149:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093785984 00000100:00100000:2.0:1788390427.463169:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093785984 00000100:00100000:2.0:1788390427.463251:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788390427.463263:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093785984:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390427.463289:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390427.463315:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd324be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec3d expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.463450:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.463479:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.463489:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.463533:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.463549:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 54 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.463565:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103233536:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390427.463676:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6878660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390427.466676:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.466776:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786112 00000100:00100000:3.0:1788390427.466789:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786112 00010000:00010000:3.0:1788390427.466862:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 55 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390427.466904:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788390427.466913:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:2357:x1875263093786112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390427.466929:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390427.466936:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 55 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.466950:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 55 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.466997:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390427.467002:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.467011:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.467017:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.467048:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390427.467104:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:2357:x1875263093786112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 191us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.467113:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00010000:00010000:2.0:1788390427.469281:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3248d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec28 expref: 54 pid: 5805 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390427.469337:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103233536:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390427.469367:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.469378:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.469385:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390427.469408:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788390427.469625:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd324be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 55 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.469645:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 54 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.469655:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390427.469658:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390427.469662:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:2.0:1788390427.469733:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10558:x1875263093785984:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6472us (9822us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788390427.469744:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1788390427.471767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.471841:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786368 00000100:00100000:3.0:1788390427.471853:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786368 00000100:00100000:3.0:1788390427.471926:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788390427.471953:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10558:x1875263093786368:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788390427.472003:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390427.472030:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32424 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec13 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.472049:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390427.472053:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390427.472120:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093786368:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 168us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.472129:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390427.475616:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390427.475719:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786496 00000100:00100000:2.0:1788390427.475733:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786496 00000100:00100000:2.0:1788390427.475819:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788390427.475832:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093786496:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:2.0:1788390427.476038:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.476071:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390427.476085:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390427.476348:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788390427.476465:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093786496:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 625us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.476475:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788390427.481889:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390427.482256:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786624 00000100:00100000:3.0:1788390427.482270:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786624 00000100:00100000:3.0:1788390427.482353:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788390427.482511:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+53:10558:x1875263093786624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390427.482542:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390427.482567:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec44 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.482643:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.482657:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.483628:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.483663:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.483703:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390427.483707:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390427.483712:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390427.483722:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390427.483821:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10558:x1875263093786624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1314us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390427.493396:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00010000:00010000:2.0:1788390428.109159:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390428.237479:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390428.237495:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390428.237544:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788390428.237553:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390428.237744:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd11500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103233664:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390428.237934:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390428.241945:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd11500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103233664:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390428.247416:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.247541:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786752 00000100:00100000:2.0:1788390428.247559:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786752 00000100:00100000:2.0:1788390428.247677:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1788390428.247704:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10559:x1875263093786752:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390428.247748:0:5805:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390428.247888:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10559:x1875263093786752:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 188us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.247896:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1788390428.252129:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.252643:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093786880 00000100:00100000:3.0:1788390428.252658:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093786880 00000100:00100000:3.0:1788390428.252805:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788390428.252827:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10559:x1875263093786880:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788390428.252925:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.252990:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.253006:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.254398:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.254423:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.254478:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255850:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255867:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255879:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390428.255930:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788390428.255935:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390428.255947:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255975:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255982:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255989:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.255995:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390428.255999:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256006:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256029:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788390428.256032:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390428.256037:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256044:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd324e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256065:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256072:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256078:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256083:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390428.256086:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256093:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256100:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff95d6a704c200) 00010000:00010000:3.0:1788390428.256103:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390428.256106:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256112:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd324e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256140:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256147:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256153:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256158:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390428.256161:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256167:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256175:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390428.256177:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390428.256180:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.256187:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd324ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.256294:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10559:x1875263093786880:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 3471us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.256305:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788390428.259330:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.259477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093787136 00000100:00100000:0.0:1788390428.259489:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093787136 00000100:00100000:0.0:1788390428.259801:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788390428.259814:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:10559:x1875263093787136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390428.259838:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390428.259859:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd324f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec4b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.259997:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260014:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260026:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390428.260038:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788390428.260134:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260143:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260149:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260170:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390428.260175:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260182:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260195:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390428.260198:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390428.260203:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260209:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd324fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260265:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd324f6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec4b expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260276:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788390428.260278:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390428.260283:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd324f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec4b expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.260292:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb200, rc 0) 00000100:00100000:0.0:1788390428.260355:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 544us (1033us total) trans 4294967395 rc 301/301 00000100:00100000:0.0:1788390428.260363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1788390428.262642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.262810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093787264 00000100:00100000:1.0:1788390428.262820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093787264 00000100:00100000:1.0:1788390428.262874:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:1.0:1788390428.262886:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787264:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390428.262924:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390428.263035:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787264:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.263044:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:1.0:1788390428.265143:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.265258:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093787520 00000100:00100000:2.0:1788390428.265268:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093787520 00000100:00100000:2.0:1788390428.265324:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788390428.265336:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787520:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390428.265371:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390428.265375:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390428.265404:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd3249b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec2f expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.265426:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390428.265431:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390428.265458:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3250b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec52 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390428.266487:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788390428.267408:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.267429:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.267442:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.267640:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3250b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec52 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.267660:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec52 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.267670:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641e000) 00010000:00010000:2.0:1788390428.267673:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390428.267688:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:2.0:1788390428.267926:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:10559:x1875263093787520:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2591us (2790us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788390428.267936:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:3.0:1788390428.270631:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.271908:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093787776 00000100:00100000:1.0:1788390428.271928:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093787776 00000100:00100000:1.0:1788390428.272134:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1788390428.272145:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:10559:x1875263093787776:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390428.272204:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390428.272231:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec52 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272259:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641e000) 00010000:00010000:1.0:1788390428.272270:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390428.272297:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272317:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272350:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272367:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272374:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272381:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.272465:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273696:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273704:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273711:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.273716:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273723:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273736:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390428.273739:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390428.273743:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273762:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd32520 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273776:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273782:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273787:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273792:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.273795:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273801:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273809:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x76e95ef (ffff95d683b5ad00) 00010000:00010000:1.0:1788390428.273811:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390428.273814:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.273820:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32527 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x76e95ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.274087:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787776:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1940us (3460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390428.274096:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1788390428.277043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.277080:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093787904 00000100:00100000:2.0:1788390428.277092:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093787904 00000100:00100000:2.0:1788390428.277141:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1788390428.277152:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:10559:x1875263093787904:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390428.277172:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390428.277194:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3252e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec59 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277229:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277243:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277253:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277361:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3252e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 57 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277378:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 56 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.277398:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788390428.277401:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390428.277412:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:2.0:1788390428.277507:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:10559:x1875263093787904:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 354us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.277514:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1788390428.283442:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.283529:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093788160 00000100:00100000:0.0:1788390428.283554:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093788160 00000100:00100000:0.0:1788390428.283621:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:0.0:1788390428.283632:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:10559:x1875263093788160:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390428.283752:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.283770:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.283783:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390428.284078:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788390428.284090:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245391128676ns, next at 246391125872ns, rc = 0 00000004:00010000:0.0:1788390428.284183:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fef1edb2 reply state 000000006318ffc8 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.284193:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390428.284314:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10559:x1875263093788160:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 680us (878us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788390428.284321:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00010000:00010000:1.0:1788390428.286058:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286075:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286093:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286099:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.286103:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286111:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286128:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788390428.286131:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390428.286136:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.286142:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd3253c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.286792:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.286845:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093788288 00000100:00100000:3.0:1788390428.286856:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093788288 00000100:00100000:3.0:1788390428.290037:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788390428.290063:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:10559:x1875263093788288:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390428.290092:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390428.290114:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec60 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.290182:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 58 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.290199:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 58 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.290221:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390428.290224:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390428.290227:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390428.290307:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10559:x1875263093788288:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 257us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.290315:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788390428.293344:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.293914:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093788416 00000100:00100000:1.0:1788390428.293924:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093788416 00000100:00100000:1.0:1788390428.294014:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788390428.294025:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093788416:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788390428.294340:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093788416:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 317us (1008us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788390428.294346:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00080000:3.0:1788390428.294578:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390428.298886:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.299382:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093788672 00000100:00100000:0.0:1788390428.299394:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093788672 00000100:00100000:0.0:1788390428.299480:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390428.299492:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:10559:x1875263093788672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390428.299943:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10559:x1875263093788672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 452us (1063us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788390428.299952:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390428.302928:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.303571:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093788928 00000100:00100000:2.0:1788390428.303589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093788928 00000100:00100000:2.0:1788390428.303707:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1788390428.303719:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10559:x1875263093788928:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788390428.303847:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10559:x1875263093788928:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 129us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.303860:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788390428.306109:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.307741:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789056 00000100:00100000:0.0:1788390428.307758:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789056 00000100:00100000:0.0:1788390428.307886:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788390428.307898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:10559:x1875263093789056:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390428.307919:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390428.307940:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd3254a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec67 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308030:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308045:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308056:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390428.308092:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390428.308112:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308139:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd3254a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec67 expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308157:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec67 expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.308166:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:0.0:1788390428.308169:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788390428.308188:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:0.0:1788390428.308262:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:10559:x1875263093789056:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 366us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390428.308270:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788390428.312277:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.312463:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789184 00000100:00100000:3.0:1788390428.312474:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789184 00000100:00100000:3.0:1788390428.312608:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788390428.312620:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2359:x1875263093789184:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390428.312646:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390428.312668:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec6e expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390428.312697:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac1c, blocks: 0x1 00010000:00010000:3.0:1788390428.312716:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=245s v=(0 0) 00010000:00010000:3.0:1788390428.312721:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390428.312731:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 10 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.312749:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 10 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.312762:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:3.0:1788390428.312999:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2359:x1875263093789184:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 381us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.313008:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788390428.315036:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.315105:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789440 00000100:00100000:1.0:1788390428.315112:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789440 00000100:00100000:1.0:1788390428.315155:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1788390428.315162:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:10559:x1875263093789440:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390428.315247:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:10559:x1875263093789440:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.315252:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1788390428.316869:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.317011:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789568 00000100:00100000:1.0:1788390428.317021:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789568 00000100:00100000:1.0:1788390428.317074:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1788390428.317084:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:10559:x1875263093789568:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390428.317100:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390428.317118:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec75 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.317148:0:8777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.317157:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390428.317161:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390428.317166:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 11 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.317199:0:8777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 11 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.317233:0:8777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 11 pid: 6653 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.317249:0:8777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103233792:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390428.317325:0:8777:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390428.319293:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.319386:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789696 00000100:00100000:2.0:1788390428.319397:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789696 00010000:00010000:2.0:1788390428.319442:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 12 pid: 6653 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.319500:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1788390428.319581:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:2356:x1875263093789696:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390428.319599:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390428.319623:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 12 pid: 6653 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.319657:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 12 pid: 6653 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.319683:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390428.319688:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390428.319695:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.319706:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.319742:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.319755:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1875263103233920:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390428.319835:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6878660c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390428.320354:0:8777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32558 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec6e expref: 12 pid: 6653 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.320368:0:8777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103233792:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390428.320395:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 11 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.320405:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62000, rc 0) 00000100:00100000:1.0:1788390428.320440:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:10559:x1875263093789568:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3356us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.320462:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1788390428.321409:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5793:1875263103233920:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788390428.321424:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390428.321471:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093789696:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1962us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.321480:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788390428.324216:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.324292:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789824 00000100:00100000:1.0:1788390428.324306:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789824 00002000:00100000:1.0:1788390428.324365:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff95d69fc22a00 x1875263093789824/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:44/0 lens 504/0 e 0 to 0 dl 1788390439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390428.324376:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fc22a00 with x1875263093789824 ext(0->12) 00002000:00010000:1.0:1788390428.324381:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fc22a00 00000100:00100000:1.0:1788390428.324418:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788390428.324442:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093789824:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788390428.324872:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:2356:x1875263093789824:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 430us (668us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788390428.324880:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:1.0:1788390428.324888:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff95d69fc22a00 x1875263093789824/t4294967308(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:44/0 lens 504/448 e 0 to 0 dl 1788390439 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390428.324896:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fc22a00 with x1875263093789824 ext(0->12) 00002000:00010000:1.0:1788390428.324900:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fc22a00 00000100:00100000:3.0:1788390428.327041:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.327110:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093789952 00000100:00100000:0.0:1788390428.327123:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093789952 00000100:00100000:0.0:1788390428.327190:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390428.327198:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:10559:x1875263093789952:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788390428.379679:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:0.0:1788390428.379697:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788390428.379733:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b2f07540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788390428.379739:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d686e60800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b2f07b40 00000020:00080000:0.0:1788390428.379742:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d686e60a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d687613c00 00000020:00080000:0.0:1788390428.379775:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788390428.379786:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788390428.379789:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:10559:x1875263093789952:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 52584us (52754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.379802:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000004:00080000:0.0:1788390428.379842:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788390428.379861:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6875df0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788390428.379865:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d682b1c300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6875df000 00000020:00080000:0.0:1788390428.379868:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d682b1ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d68f5ac000 00000020:00080000:0.0:1788390428.379882:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788390428.380096:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788390428.380196:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390428.380210:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103234048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788390428.380260:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390428.380408:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103234304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788390428.380442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390428.380477:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390428.380483:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103234176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788390428.380506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390428.380563:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103234048 00000100:00100000:3.0:1788390428.380571:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103234048 00000100:00100000:3.0:1788390428.380607:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103234304 00000100:00100000:3.0:1788390428.380610:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103234304 00000100:00100000:3.0:1788390428.380621:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103234176 00000100:00100000:3.0:1788390428.380624:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103234176 00000100:00100000:3.0:1788390428.380635:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390428.380643:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3288:x1875263103234048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788390428.380670:0:6653:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788390428.380701:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a98ac1b, atime: 0x6a98ac1b, ctime: 0x6a98ac1b, blocks: 0x1 00010000:00010000:3.0:1788390428.380709:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.380725:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=245s v=(0 0) 00010000:00010000:3.0:1788390428.380729:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390428.380736:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.380753:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.380764:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.380772:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.380790:0:6653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788390428.381271:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3288:x1875263103234048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 626us (1008us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788390428.381279:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390428.381299:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390428.381307:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68529e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103234304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788390428.381406:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788390428.381410:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788390428 00002000:00010000:3.0:1788390428.381413:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788390428.381414:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788390428 -> 1788390428 00002000:00010000:3.0:1788390428.381417:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788390428.381464:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68529e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103234304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (1021us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788390428.381470:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390428.381603:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390428.381610:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103234176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788390428.381622:0:6653:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788390428.381635:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.381652:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.381660:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788390428.381663:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390428.381667:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.381711:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 11 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.381726:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 11 pid: 6652 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.381741:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103234432:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390428.381802:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9bc00 going to sleep for 11 seconds 00000004:00080000:3.0:1788390428.381843:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bbd13b80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788390428.381849:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103234048:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788390428.381874:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69fc21500/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788390428.381879:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103234304:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788390428.382246:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390428.382255:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.382277:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390428.382282:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.382292:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.382311:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.382318:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd32566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.382339:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390428.382341:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390428.382343:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390428.385266:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.385703:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790080 00000100:00100000:2.0:1788390428.385714:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790080 00000100:00100000:2.0:1788390428.385770:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1788390428.385781:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:2357:x1875263093790080:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788390428.386136:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103234432:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390428.386196:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.386292:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.386337:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790208 00000100:00100000:3.0:1788390428.386341:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790208 00010000:00010000:3.0:1788390428.386362:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 13 pid: 6652 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.386427:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788390428.386457:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2357:x1875263093790208:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390428.386472:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390428.386479:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 13 pid: 6652 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.386492:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 13 pid: 6652 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.386513:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd32328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfebd4 expref: 13 pid: 6652 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.386526:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390428.386530:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390428.386534:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.386541:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.386564:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390428.386591:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.386599:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.386609:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.386610:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:2357:x1875263093790208:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 165us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.386618:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00010000:00010000:1.0:1788390428.386618:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.386634:0:6653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390428.387312:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103234176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5699us (6802us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788390428.387326:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788390428.387327:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390428.387344:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.387355:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390428.387379:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390428.387390:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69fc20a80/2, rc 0, transno 4294967310 00010000:00010000:0.0:1788390428.387391:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.387399:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103234176:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788390428.387412:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.387422:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd3256d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.387466:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390428.387469:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390428.387470:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788390428.417375:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788390428.417405:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788390428.417413:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788390428.417531:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093790080:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 31734us (32256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.417546:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788390428.421693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.422129:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790464 00000100:00100000:1.0:1788390428.422139:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790464 00000100:00100000:1.0:1788390428.422245:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:1.0:1788390428.422256:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:10559:x1875263093790464:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390428.422327:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390428.422367:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec67 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.422387:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788390428.422392:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390428.422424:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.422437:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.422458:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390428.422730:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000899b69d0 reply state 000000006c8fc7d7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.422741:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390428.422849:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:10559:x1875263093790464:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 594us (1166us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788390428.422872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788390428.425655:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.425684:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790592 00000100:00100000:0.0:1788390428.425691:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790592 00000100:00100000:0.0:1788390428.425729:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788390428.425736:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093790592:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788390428.425909:0:8777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788390428.425912:0:8777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788390428 -> 1788390427 00002000:00010000:0.0:1788390428.425914:0:8777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788390427 00002000:00010000:0.0:1788390428.425915:0:8777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788390428 -> 1788390427 00002000:00010000:0.0:1788390428.425917:0:8777:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788390428.425945:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.425981:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093790592:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 221us (312us total) trans 4294967311 rc 0/0 00010000:00010000:3.0:1788390428.425988:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.425989:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:3.0:1788390428.426000:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.426007:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390428.426012:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.426020:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.426036:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390428.426039:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390428.426043:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.426049:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.427439:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.427498:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790848 00000100:00100000:2.0:1788390428.427503:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790848 00000100:00100000:2.0:1788390428.427586:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1788390428.427597:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:10559:x1875263093790848:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788390428.427643:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.427663:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 15 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.427669:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.427694:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 15 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.427704:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 15 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.427714:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103234560:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390428.427806:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390428.430642:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.430692:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093790976 00000100:00100000:1.0:1788390428.430701:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093790976 00010000:00010000:1.0:1788390428.430742:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.430758:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103234560:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390428.430779:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.431151:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788390428.431159:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:2356:x1875263093790976:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390428.431227:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390428.431233:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431242:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431280:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec59 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431294:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788390428.431299:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431308:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431313:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.431336:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390428.431376:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2356:x1875263093790976:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 218us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.431380:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:0.0:1788390428.431423:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431428:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431461:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431468:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431475:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431481:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390428.431485:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431493:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431505:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:0.0:1788390428.431507:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788390428.431510:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.431559:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3257b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.431588:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10559:x1875263093790848:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3994us (4155us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788390428.431593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788390428.433708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.433762:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093791104 00000100:00100000:1.0:1788390428.433770:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093791104 00000100:00100000:1.0:1788390428.433813:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1788390428.433819:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093791104:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788390428.433852:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.433867:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.433873:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390428.433876:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390428.433879:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.433903:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 7 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.433911:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 7 pid: 8777 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.433937:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103234688:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390428.434024:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390428.436704:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6653:1875263103234688:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390428.436727:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.438170:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.438279:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093791232 00000100:00100000:1.0:1788390428.438287:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093791232 00010000:00010000:1.0:1788390428.438320:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 8 pid: 8777 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.438345:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1788390428.438351:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093791232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390428.438362:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390428.438380:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 8 pid: 8777 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.438389:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 8 pid: 8777 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.438405:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd3255f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec75 expref: 8 pid: 8777 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.438416:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390428.438431:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390428.438436:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.438455:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.438488:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390428.438541:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093791232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.438547:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00010000:00010000:3.0:1788390428.438896:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.438908:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.438934:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.438951:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.438979:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.438988:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390428.438995:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.439004:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.439017:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.439025:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086da5b23/0x9aafc5f04cd32582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.439102:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093791104:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5282us (5402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.439108:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390428.442726:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390428.442778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093791488 00000100:00100000:2.0:1788390428.442786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093791488 00000100:00100000:2.0:1788390428.442831:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1788390428.442838:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10559:x1875263093791488:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788390428.442900:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.442913:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.442932:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.443116:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.443123:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 15 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.443129:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.443153:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 15 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390428.443162:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 15 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.443188:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103234816:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390428.443262:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390428.444776:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103234816:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390428.444793:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.445671:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.446016:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093791616 00000100:00100000:3.0:1788390428.446026:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093791616 00010000:00010000:3.0:1788390428.446064:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.446105:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1788390428.446114:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:2357:x1875263093791616:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390428.446139:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390428.446146:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446159:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446182:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd32543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec60 expref: 16 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446204:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390428.446209:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446217:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446224:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.446246:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390428.446310:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2357:x1875263093791616:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 197us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.446320:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00010000:00010000:0.0:1788390428.446399:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.446407:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390428.446603:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967400 00000001:00080000:0.0:1788390428.446868:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967401 00000001:00080000:0.0:1788390428.446918:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000100:00100000:0.0:1788390428.447036:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103234944:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788390428.447082:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390428.447120:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6884b0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390428.447265:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103234944 00000100:00100000:3.0:1788390428.447272:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103234944 00000100:00100000:3.0:1788390428.447352:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390428.447362:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1875263103234944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390428.447425:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1875263103234944:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.447453:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390428.447560:0:5807:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788390428.447566:0:5807:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788390428.447587:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69fc21500, transno 4294967309 00000100:00100000:1.0:1788390428.447610:0:5807:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d69fc20a80 x1875263103234176/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788390444 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390428.447621:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103234944:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788390428.448115:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000100:00100000:1.0:1788390428.448168:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103235072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788390428.448199:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390428.448669:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390428.448712:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103235072 00000100:00100000:2.0:1788390428.448721:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103235072 00000100:00100000:2.0:1788390428.448752:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390428.448760:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1875263103235072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788390428.448928:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5807:x1875263103235072:12345-0@lo:1000:mdt00_002.0 Request processed in 168us (727us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788390428.448937:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390428.448990:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103235072:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788390428.449022:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449031:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449049:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449055:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.449060:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449067:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449082:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788390428.449086:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390428.449090:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449095:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32590 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449123:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449128:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449134:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449138:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.449141:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449156:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449164:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390428.449166:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390428.449173:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449183:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449191:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.449225:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.449235:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103235200:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788390428.449287:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390428.454998:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.455098:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093791744 00000100:00100000:3.0:1788390428.455106:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093791744 00000100:00100000:1.0:1788390428.455115:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103235200:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788390428.455143:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455154:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd324d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.455161:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390428.455175:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:10558:x1875263093791744:12345-192.168.202.1@tcp:49:lfs.0 00010000:00010000:1.0:1788390428.455189:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455216:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455228:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455239:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455245:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455264:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455271:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.455275:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455283:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455294:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390428.455296:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390428.455299:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455305:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32597 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455314:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455325:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455332:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455337:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390428.455340:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455346:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455353:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:1.0:1788390428.455355:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390428.455358:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.455363:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32589 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390428.455422:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:10558:x1875263093791744:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 247us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390428.455432:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1788390428.455837:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10559:x1875263093791488:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 12996us (13118us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1788390428.455846:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000020:00080000:1.0:1788390428.455850:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788390428.457061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000040:00080000:0.0:1788390428.457232:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390428.457243:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788390428.457481:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.457556:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792256 00000100:00100000:3.0:1788390428.457565:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792256 00000100:00100000:3.0:1788390428.457607:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788390428.457617:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:10559:x1875263093792256:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788390428.457851:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788390428.457861:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390428.458009:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792000 00000100:00100000:1.0:1788390428.458014:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792000 00000100:00100000:1.0:1788390428.458046:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788390428.458052:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10558:x1875263093792000:12345-192.168.202.1@tcp:58:lfs.0 00000004:00080000:0.0:1788390428.458455:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788390428.458535:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000001:00080000:0.0:1788390428.458583:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788390428.458622:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10558:x1875263093792000:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 569us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390428.458629:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00010000:00010000:0.0:1788390428.458632:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458648:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458659:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458668:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458675:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458685:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.458745:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788390428.458797:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10559:x1875263093792256:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1182us (1316us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788390428.458803:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000020:00080000:0.0:1788390428.458806:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390428.458870:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390428.458875:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.458882:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390428.458886:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.458894:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.458905:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788390428.458908:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390428.458912:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.458918:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3259e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.458942:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390428.458944:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390428.458946:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390428.485063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390428.485900:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792384 00000100:00100000:1.0:1788390428.485912:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792384 00000100:00100000:1.0:1788390428.486046:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788390428.486057:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:10561:x1875263093792384:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390428.486084:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390428.486106:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd325a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec7c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486185:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486200:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486211:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486227:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486234:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486240:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486520:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486531:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 21 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486540:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486574:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 21 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390428.486588:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 21 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390428.486601:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103235328:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390428.486941:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390428.489952:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390428.490046:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792640 00000100:00100000:0.0:1788390428.490056:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792640 00000100:00100000:0.0:1788390428.490160:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788390428.490172:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:5589:x1875263093792640:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390428.490327:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103235328:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390428.490413:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390428.490554:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:5589:x1875263093792640:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 384us (611us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1788390428.490562:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788390428.492917:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390428.493061:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792768 00000100:00100000:3.0:1788390428.493072:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792768 00010000:00010000:3.0:1788390428.493113:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 23 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390428.493200:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788390428.493211:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:2356:x1875263093792768:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390428.493226:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390428.493234:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 23 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493249:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 23 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493272:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd324c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec3d expref: 23 pid: 8163 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493287:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390428.493294:0:11126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493304:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493312:0:11126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390428.493366:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390428.493426:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:2356:x1875263093792768:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 210us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390428.493435:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00010000:00010000:0.0:1788390428.493581:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493588:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390428.493629:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788390428.493633:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390428.493653:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493663:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493670:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493674:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493679:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493682:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390428.493685:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493689:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493701:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390428.493703:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390428.493706:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493710:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd325ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493717:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493720:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493724:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493727:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390428.493729:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493732:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493735:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95d683b5ad00) 00010000:00010000:0.0:1788390428.493737:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390428.493738:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493741:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd325b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493778:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd325a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec7c expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493787:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec7c expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390428.493792:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390428.493793:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390428.493795:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62000, rc 0) 00000100:00100000:0.0:1788390428.493822:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10561:x1875263093792384:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 7769us (8771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390428.493826:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000001:00080000:2.0:1788390428.652771:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788390428.652795:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788390428.652803:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:1.0:1788390429.016659:0:12064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390429.016669:0:12064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390429.016714:0:12064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788390429.016720:0:12064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788390429.135406:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390429.518511:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390429.518520:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390429.518601:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788390429.518609:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390429.518738:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103235456:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390429.518844:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692df4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390429.523769:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1aed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103235456:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390429.528248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390429.528872:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093792896 00000100:00100000:2.0:1788390429.528883:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093792896 00000100:00100000:2.0:1788390429.528993:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1788390429.529005:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10574:x1875263093792896:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390429.529042:0:5805:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390429.529165:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10574:x1875263093792896:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 162us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390429.529173:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00080000:3.0:1788390429.529257:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390429.534166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390429.534298:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093793152 00000100:00100000:0.0:1788390429.534310:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093793152 00000100:00100000:0.0:1788390429.534571:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1788390429.534584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:10574:x1875263093793152:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390429.534606:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390429.534627:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd325c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec83 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390429.534728:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd325c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390429.534742:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd325c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390429.534754:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd325c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390429.534781:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788390429.534910:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd325c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec83 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390429.534928:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd325c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec83 expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390429.534936:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390429.534938:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390429.534941:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:0.0:1788390429.536469:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:10574:x1875263093793152:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1877us (2305us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788390429.536482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1788390429.546336:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390429.546375:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390429.546456:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093793280 00000100:00100000:3.0:1788390429.546466:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093793280 00000100:00100000:3.0:1788390429.546538:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390429.546551:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:2357:x1875263093793280:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390429.546567:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390429.546593:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd325c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec83 expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390429.546613:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:3.0:1788390429.546618:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390429.546679:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:2357:x1875263093793280:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 130us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390429.546686:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788390429.546992:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093793536 00000100:00100000:2.0:1788390429.546997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093793536 00000100:00100000:2.0:1788390429.547089:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1788390429.547099:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:10574:x1875263093793536:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788390429.547184:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547199:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547209:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547405:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547426:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547433:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547447:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390429.547452:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547459:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547468:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390429.547471:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390429.547475:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390429.547481:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd325d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390429.547626:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:10574:x1875263093793536:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 528us (1249us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788390429.547634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000040:00080000:0.0:1788390429.548547:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390429.548552:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390429.549090:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788390429.549099:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390429.551398:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390429.552067:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093793792 00000100:00100000:2.0:1788390429.552078:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093793792 00000100:00100000:2.0:1788390429.552267:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788390429.552278:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:10574:x1875263093793792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390429.552495:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:10574:x1875263093793792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 219us (1107us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788390429.552503:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00010000:00010000:0.0:1788390430.157480:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390430.157596:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103235584:0@lo:400:kworker.0 00000100:00100000:0.0:1788390430.157669:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.157710:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103235584 00000100:00100000:2.0:1788390430.157719:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103235584 00000100:00100000:2.0:1788390430.157768:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788390430.157777:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103235584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.158472:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103235584:12345-0@lo:400:kworker.0 Request processed in 694us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390430.158482:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788390430.158525:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103235712:0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.158564:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.158565:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390430.158593:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103236224:0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.158600:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.158626:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390430.158632:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.158637:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103235968:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.158659:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390430.158667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390430.158669:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103236096:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.158701:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.158710:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236224 00000100:00100000:2.0:1788390430.158715:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236224 00000100:00100000:2.0:1788390430.158760:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103235968 00000100:00100000:1.0:1788390430.158761:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103235712 00000100:00100000:1.0:1788390430.158766:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103235712 00000100:00100000:2.0:1788390430.158772:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103235968 00000100:00100000:2.0:1788390430.158802:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390430.158810:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.158816:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103235840 00000100:00100000:1.0:1788390430.158821:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103235840 00000100:00100000:1.0:1788390430.158841:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236096 00000100:00100000:1.0:1788390430.158844:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236096 00000100:00100000:2.0:1788390430.158859:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103236224:12345-0@lo:400:kworker.0 Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390430.158866:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788390430.158869:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390430.158878:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103235712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.158899:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788390430.158909:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103235968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.158918:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103235712:12345-0@lo:400:kworker.0 Request processed in 41us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390430.158925:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788390430.158942:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788390430.158952:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103235968:12345-0@lo:400:kworker.0 Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390430.158952:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103235840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.158983:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788390430.159005:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390430.159010:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390430.159012:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390430.159026:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103235840:12345-0@lo:400:kworker.0 Request processed in 76us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390430.159034:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788390430.159050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788390430.159057:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103235968:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.159058:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103236096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390430.159078:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.159096:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103236096:12345-0@lo:400:kworker.0 Request processed in 39us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390430.159103:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390430.159136:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103236096:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.159145:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103235712:0@lo:400:kworker.0 00000100:00100000:1.0:1788390430.159153:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788390430.159158:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788390430.159173:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc7cbb80, transno 4294967301 00000004:00080000:1.0:1788390430.159183:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788390430.159192:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bbd13b80, transno 4294967304 00000100:00100000:1.0:1788390430.159881:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788390430.161119:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103235584:0@lo:400:kworker.0 00000040:00080000:0.0:1788390430.605151:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390430.605161:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390430.605205:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788390430.605211:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788390430.605553:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390430.605557:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390430.605592:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788390430.605597:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390430.669721:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390430.669785:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103236352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390430.669857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.669918:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236352 00000100:00100000:2.0:1788390430.669926:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236352 00000100:00100000:2.0:1788390430.670089:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390430.670100:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103236352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390430.670142:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390430.670186:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103236352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390430.670194:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788390430.670707:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103236352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390430.757992:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390430.758173:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794048 00000100:00100000:2.0:1788390430.758184:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794048 00000100:00100000:2.0:1788390430.758258:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:2.0:1788390430.758269:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:10594:x1875263093794048:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390430.758293:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390430.758313:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd325dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec8a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.758413:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd325e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.758437:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd325e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.758450:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd325e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390430.758460:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788390430.758583:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd325dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec8a expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.758601:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd325e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec8a expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.758610:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390430.758614:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788390430.758618:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:2.0:1788390430.758683:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10594:x1875263093794048:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 415us (727us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788390430.758690:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:1.0:1788390430.763647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390430.764096:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794176 00000100:00100000:2.0:1788390430.764119:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794176 00000100:00100000:2.0:1788390430.764175:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1788390430.764187:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10594:x1875263093794176:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1788390430.764258:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764277:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764290:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764316:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764323:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764329:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764335:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390430.764339:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764346:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764357:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390430.764360:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390430.764366:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390430.764382:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd325f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390430.764464:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:10594:x1875263093794176:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 279us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390430.764472:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:3.0:1788390430.846539:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390430.848047:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794304 00000100:00100000:2.0:1788390430.848061:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794304 00000100:00100000:3.0:1788390430.851255:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788390430.851283:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093794304:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1788390430.851301:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390430.851318:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd325f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec91 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390430.851341:0:8777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a98ac1b, atime: 0x6a98ac1b, ctime: 0x6a98ac1b, blocks: 0xb 00010000:00010000:3.0:1788390430.851358:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=247s v=(0 0) 00010000:00010000:3.0:1788390430.851361:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390430.851368:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd325f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec91 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390430.852365:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd325f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec91 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390430.852385:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390430.852466:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093794304:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1184us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390430.852472:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00080000:2.0:1788390430.855079:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390430.859755:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390430.859828:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794432 00000100:00100000:1.0:1788390430.859839:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794432 00002000:00100000:1.0:1788390430.859892:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff95d69fc21c00 x1875263093794432/t0(0) o3->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:46/0 lens 488/0 e 0 to 0 dl 1788390441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390430.859923:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fc21c00 with x1875263093794432 ext(0->4095) 00002000:00010000:1.0:1788390430.859929:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fc21c00 00000100:00100000:1.0:1788390430.860048:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788390430.860059:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093794432:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:1.0:1788390430.860280:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093794432:12345-192.168.202.1@tcp:3:cat.0 Request processed in 222us (535us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788390430.860289:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:1.0:1788390430.860297:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff95d69fc21c00 x1875263093794432/t0(0) o3->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:46/0 lens 488/4536 e 0 to 0 dl 1788390441 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390430.860304:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69fc21c00 with x1875263093794432 ext(0->4095) 00002000:00010000:1.0:1788390430.860308:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69fc21c00 00010000:00010000:3.0:1788390431.181209:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390431.867113:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390431.867142:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390431.867187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390431.867201:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390431.867216:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390431.867250:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794560 00000100:00100000:3.0:1788390431.867257:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794560 00000100:00100000:3.0:1788390431.867296:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:3.0:1788390431.867303:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093794560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390431.867366:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093794560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390431.867383:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:1.0:1788390431.867718:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795072 00000100:00100000:1.0:1788390431.867722:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795072 00000100:00100000:1.0:1788390431.867758:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794688 00000100:00100000:1.0:1788390431.867761:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794688 00000100:00100000:1.0:1788390431.867778:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390431.867794:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093795072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390431.867833:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093795072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390431.867849:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390431.867863:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1788390431.867870:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:2358:x1875263093794688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390431.867896:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:2358:x1875263093794688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390431.867902:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1788390431.868116:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794816 00000100:00100000:2.0:1788390431.868119:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794816 00000100:00100000:2.0:1788390431.868147:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093794944 00000100:00100000:2.0:1788390431.868148:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093794944 00000100:00100000:2.0:1788390431.868164:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390431.868168:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093794816:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390431.868191:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093794816:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390431.868195:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390431.868203:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788390431.868206:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093794944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390431.868219:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093794944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 13us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390431.868222:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00080000:2.0:1788390431.868595:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390431.868599:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390432.205148:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390432.205420:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103236480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390432.205492:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390432.205684:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236480 00000100:00100000:2.0:1788390432.205693:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236480 00000100:00100000:2.0:1788390432.205769:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788390432.205780:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103236480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390432.205813:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390432.205870:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103236480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390432.205877:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788390432.205932:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390432.206017:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103236480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390433.229293:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788390433.780623:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788390433.780638:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788390433.780644:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788390433.789679:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:0.0:1788390433.789709:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788390433.789736:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d692df4f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788390433.789742:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d692df4cc0 00000020:00080000:0.0:1788390433.789746:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5867ee400 00000001:00080000:0.0:1788390433.789753:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1788390433.789806:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788390433.790016:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788390434.088677:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390434.088765:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795200 00000100:00100000:0.0:1788390434.088773:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795200 00000100:00080000:2.0:1788390434.088828:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390434.088841:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1788390434.088854:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:10239:x1875263093795200:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788390434.088939:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:10239:x1875263093795200:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390434.088951:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1788390434.094351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390434.094445:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795456 00000100:00100000:0.0:1788390434.094453:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795456 00000100:00100000:0.0:1788390434.094500:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390434.094508:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:10239:x1875263093795456:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390434.094813:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:10239:x1875263093795456:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 304us (473us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788390434.094834:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00010000:00010000:3.0:1788390434.253242:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390434.309638:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390434.309778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795584 00000100:00100000:2.0:1788390434.309788:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795584 00000100:00100000:2.0:1788390434.309868:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1788390434.309879:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:11045:x1875263093795584:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788390434.309900:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390434.309919:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec98 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310000:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310014:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310025:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390434.310059:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390434.310075:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390434.310118:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310143:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310160:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390434.310169:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:2.0:1788390434.310171:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390434.310175:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:2.0:1788390434.310235:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:11045:x1875263093795584:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 358us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390434.310242:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00080000:0.0:1788390434.310644:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390435.277143:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390435.277250:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390435.277270:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103236608:0@lo:400:kworker.0 00000100:00100000:1.0:1788390435.277335:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.277465:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236608 00000100:00100000:3.0:1788390435.277473:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236608 00000100:00100000:3.0:1788390435.277516:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788390435.277527:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103236608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390435.277604:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103236736:0@lo:400:kworker.0 00000100:00100000:1.0:1788390435.277640:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390435.277658:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236736 00000100:00100000:0.0:1788390435.277664:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236736 00000100:00100000:0.0:1788390435.277702:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788390435.277712:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103236736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280107:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103236608:12345-0@lo:400:kworker.0 Request processed in 2570us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.280123:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788390435.280217:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103236864:0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280265:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.280310:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390435.280317:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103236992:0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280344:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.280375:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc09c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103237120:0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.280445:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236864 00000100:00100000:3.0:1788390435.280453:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236864 00000100:00100000:3.0:1788390435.280500:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103237120 00000100:00100000:3.0:1788390435.280503:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103237120 00000100:00100000:3.0:1788390435.280522:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390435.280531:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103236864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280577:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103236864:12345-0@lo:400:kworker.0 Request processed in 47us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.280600:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390435.280611:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390435.280617:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103237120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280647:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103237120:12345-0@lo:400:kworker.0 Request processed in 30us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.280652:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390435.280686:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc09c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103237120:0@lo:400:kworker.0 00000100:00100000:1.0:1788390435.280787:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103236608:0@lo:400:kworker.0 00000100:00100000:2.0:1788390435.280821:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103236992 00000100:00100000:2.0:1788390435.280826:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103236992 00000100:00100000:2.0:1788390435.280858:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390435.280865:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103236992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280922:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103236864:0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.280994:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390435.281002:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103237248:0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.281027:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.281072:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103237248 00000100:00100000:3.0:1788390435.281076:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103237248 00000100:00100000:3.0:1788390435.281101:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390435.281108:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103237248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390435.281142:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103237248:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.281148:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390435.281170:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103237248:0@lo:400:kworker.0 00000100:00080000:3.0:1788390435.281197:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390435.281201:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390435.281204:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390435.281349:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103236736:12345-0@lo:400:kworker.0 Request processed in 3638us (3708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390435.281357:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788390435.281566:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103236736:0@lo:400:kworker.0 00000100:00100000:2.0:1788390435.283100:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103236992:12345-0@lo:400:kworker.0 Request processed in 2227us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390435.283111:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390435.283357:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788390435.283365:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69fc20a80, transno 4294967310 00000004:00080000:3.0:1788390435.283395:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788390435.283435:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103236992:0@lo:400:kworker.0 00000100:00100000:1.0:1788390435.789156:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103237376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390435.789222:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390435.789288:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103237376 00000100:00100000:1.0:1788390435.789295:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103237376 00000100:00100000:1.0:1788390435.789334:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390435.789342:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103237376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390435.789374:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390435.789433:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103237376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390435.789445:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390435.789502:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103237376:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788390436.045115:0:12314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:07:15 (1788390435) 00010000:00010000:0.0:1788390436.304553:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390436.839353:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390436.839417:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795840 00000100:00100000:3.0:1788390436.839426:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795840 00000100:00100000:3.0:1788390436.839492:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:3.0:1788390436.839502:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+14:11310:x1875263093795840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390436.839531:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390436.839546:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd3260e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfec9f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839618:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788390436.839623:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390436.839630:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839639:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839649:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839654:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839658:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839904:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32623 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839920:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32623 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.839927:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32623 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390436.839935:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788390436.840042:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840049:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840055:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840060:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390436.840064:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840071:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840083:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788390436.840085:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390436.840090:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840095:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32615 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840111:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840123:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840129:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840134:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390436.840137:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840143:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840149:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a704cc00) 00010000:00010000:3.0:1788390436.840150:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390436.840152:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840156:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd3261c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840476:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd3260e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec9f expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840486:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32623 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec9f expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390436.840491:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788390436.840492:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390436.840498:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:3.0:1788390436.840555:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11310:x1875263093795840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1055us (1213us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788390436.840562:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1788390436.848322:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390436.848459:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093795968 00000100:00100000:3.0:1788390436.848470:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093795968 00000100:00100000:3.0:1788390436.848543:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:3.0:1788390436.848555:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11310:x1875263093795968:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788390436.848667:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11310:x1875263093795968:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390436.848673:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:3.0:1788390436.848902:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390436.849059:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796096 00000100:00100000:0.0:1788390436.849065:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796096 00000100:00100000:0.0:1788390436.849104:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390436.849110:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:2356:x1875263093796096:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390436.849119:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390436.849142:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32623 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec9f expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390436.849162:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788390436.849166:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390436.849186:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:2356:x1875263093796096:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390436.849192:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390436.982818:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390436.982900:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390436.982941:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390436.982983:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390436.983043:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796224 00000100:00100000:2.0:1788390436.983052:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796224 00000100:00100000:2.0:1788390436.983100:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:2.0:1788390436.983110:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093796224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390436.983190:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093796224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390436.983198:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:2.0:1788390436.983312:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796608 00000100:00100000:2.0:1788390436.983315:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796608 00000100:00100000:2.0:1788390436.983351:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788390436.983357:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2358:x1875263093796608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390436.983400:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2358:x1875263093796608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390436.983406:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00080000:2.0:1788390436.983420:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390436.989333:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796352 00000100:00100000:3.0:1788390436.989349:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796352 00000100:00100000:3.0:1788390436.989438:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796480 00000100:00100000:3.0:1788390436.989442:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796480 00000100:00100000:3.0:1788390436.989468:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1788390436.989480:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2358:x1875263093796352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390436.989555:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2358:x1875263093796352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (6749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390436.989562:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1788390436.989579:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390436.989585:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093796480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390436.989608:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093796480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (6624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390436.989614:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00080000:2.0:1788390436.989711:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390436.989715:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390437.327082:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390437.331396:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390437.331420:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103237504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390437.331493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390437.331562:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103237504 00000100:00100000:0.0:1788390437.331570:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103237504 00000100:00100000:0.0:1788390437.331628:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788390437.331637:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103237504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390437.331667:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390437.331702:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103237504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390437.331708:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788390437.331731:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390437.331786:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103237504:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788390437.773188:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390437.773197:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390437.775403:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788390437.775419:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390438.161225:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.164920:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796736 00000100:00100000:1.0:1788390438.164933:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796736 00000100:00100000:1.0:1788390438.165031:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:1.0:1788390438.165043:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:11352:x1875263093796736:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390438.165066:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.165088:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeca6 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165152:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165166:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165178:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165193:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165200:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165216:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165423:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165432:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165439:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165444:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390438.165449:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165457:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165470:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390438.165473:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390438.165478:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165484:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165496:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165502:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165515:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165519:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390438.165523:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165529:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165537:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95d683b5a400) 00010000:00010000:1.0:1788390438.165539:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390438.165542:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165548:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3263f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165586:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32631 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeca6 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165599:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390438.165602:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390438.165606:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd32631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeca6 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.165616:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390438.165685:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:11352:x1875263093796736:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 644us (4470us total) trans 0 rc 301/301 00000100:00100000:1.0:1788390438.165702:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00080000:0.0:1788390438.166508:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390438.179189:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.179235:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093796992 00000100:00100000:0.0:1788390438.179245:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093796992 00000100:00100000:0.0:1788390438.179299:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1788390438.179309:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:11352:x1875263093796992:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:0.0:1788390438.179379:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390438.179408:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd31fbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeae6 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.179427:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:0.0:1788390438.179432:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390438.179672:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.179687:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.179705:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.179739:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.179755:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 5 pid: 5807 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.179771:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103237632:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390438.179867:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390438.182384:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103237632:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390438.182417:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.183175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.183259:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797120 00000100:00100000:1.0:1788390438.183267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797120 00010000:00010000:1.0:1788390438.183324:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 6 pid: 5807 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.183373:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788390438.183383:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2356:x1875263093797120:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390438.183397:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390438.183404:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 6 pid: 5807 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183418:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 6 pid: 5807 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183440:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec98 expref: 6 pid: 5807 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183453:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390438.183458:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183467:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183475:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183509:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390438.183558:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2356:x1875263093797120:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.183567:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00010000:00010000:1.0:1788390438.183594:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183602:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183624:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183634:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.183643:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390438.185871:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788390438.185889:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185900:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185908:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185914:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390438.185919:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185934:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185949:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390438.185952:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390438.185957:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.185985:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32646 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390438.186005:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e15cc8f6 reply state 000000006ce0b1a1 transno 4294967414 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.186014:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1788390438.186139:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390438.189257:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11352:x1875263093796992:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 9940us (10070us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788390438.189269:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00010000:00010000:0.0:1788390438.193465:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193485:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193494:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193500:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.193506:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193523:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193541:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95d683b5a400) 00010000:00010000:0.0:1788390438.193544:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.193549:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.193556:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3264d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.264720:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.264829:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797248 00000100:00100000:1.0:1788390438.264840:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797248 00000100:00100000:1.0:1788390438.264934:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1788390438.264945:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+15:11360:x1875263093797248:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:1.0:1788390438.265005:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.265029:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecad expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265099:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265132:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265144:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390438.265179:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390438.265182:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390438.265203:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265228:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecad expref: 17 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265244:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecad expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.265252:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:1.0:1788390438.265255:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390438.265259:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390438.265313:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11360:x1875263093797248:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 371us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.265321:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1788390438.310720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.311151:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797376 00000100:00100000:0.0:1788390438.311161:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797376 00000100:00100000:2.0:1788390438.311324:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1788390438.311335:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+16:11366:x1875263093797376:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390438.311369:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390438.311389:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecb4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311449:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311464:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311474:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311500:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311506:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311513:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311601:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311609:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311616:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390438.311652:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788390438.311655:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390438.311673:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311684:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311690:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311696:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311712:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390438.311716:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311723:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311735:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:2.0:1788390438.311739:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390438.311743:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311749:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311762:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311769:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311775:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311781:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390438.311784:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311790:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311807:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95d68641e000) 00010000:00010000:2.0:1788390438.311809:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390438.311812:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311818:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311848:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd32662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecb4 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311862:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecb4 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.311869:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390438.311871:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390438.311873:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:2.0:1788390438.311937:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:11366:x1875263093797376:12345-192.168.202.1@tcp:101:bash.0 Request processed in 604us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390438.311944:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1788390438.318043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.318130:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797632 00000100:00100000:0.0:1788390438.318140:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797632 00000100:00100000:0.0:1788390438.318201:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:0.0:1788390438.318212:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:11366:x1875263093797632:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390438.318232:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390438.318253:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3267e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecbb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318388:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318404:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318415:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318470:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318479:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.318486:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390438.319023:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788390438.319181:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319191:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319199:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319233:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319240:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319247:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319252:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.319257:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319276:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319289:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390438.319292:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.319297:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319302:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32685 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390438.319315:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa024923 reply state 00000000c9df7ce4 transno 4294967415 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.319323:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390438.319364:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3267e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319378:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.319385:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:0.0:1788390438.319386:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390438.319389:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788390438.319469:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11366:x1875263093797632:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1259us (1436us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788390438.319478:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00010000:00010000:3.0:1788390438.324678:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324697:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324705:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324711:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390438.324716:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324723:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324740:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23c00) 00010000:00010000:3.0:1788390438.324743:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390438.324748:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.324754:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3268c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390438.328050:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.328195:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797760 00000100:00100000:1.0:1788390438.328205:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797760 00000100:00100000:1.0:1788390438.328282:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788390438.328293:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2356:x1875263093797760:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390438.328325:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.328346:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecc2 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390438.328385:0:8777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390438.328404:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=255s v=(0 0) 00010000:00010000:1.0:1788390438.328409:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:0.0:1788390438.328516:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788390438.328545:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 6 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.328569:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 6 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.328582:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390438.328650:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093797760:12345-192.168.202.1@tcp:101:bash.0 Request processed in 359us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.328657:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788390438.331759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390438.331840:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093797888 00000100:00100000:2.0:1788390438.331849:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093797888 00000100:00100000:2.0:1788390438.331907:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788390438.331918:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:11366:x1875263093797888:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390438.331936:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390438.331953:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecc9 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.332015:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.332021:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390438.332024:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390438.332028:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.332051:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.332060:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390438.332070:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103237760:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390438.332147:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a37470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390438.334196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.334275:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103237760:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390438.334307:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 7 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390438.334318:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093798016 00010000:00010000:0.0:1788390438.334326:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:3.0:1788390438.334327:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093798016 00010000:00010000:3.0:1788390438.334384:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 8 pid: 8777 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390438.334428:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1788390438.334438:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093798016:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788390438.334541:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:11366:x1875263093797888:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2624us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390438.334549:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00010000:00010000:3.0:1788390438.334617:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390438.334637:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.334647:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.334663:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd326a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc2 expref: 7 pid: 8777 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.334673:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390438.334676:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390438.334682:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.334688:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.334717:0:11126:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390438.335579:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11126:1875263103237888:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390438.335714:0:11126:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390438.338858:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11126:1875263103237888:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788390438.338882:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390438.338951:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093798016:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4515us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390438.338979:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788390438.339184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390438.339246:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093798272 00000100:00100000:2.0:1788390438.339253:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093798272 00000100:00100000:2.0:1788390438.339822:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788390438.339834:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11366:x1875263093798272:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788390438.340423:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11366:x1875263093798272:12345-192.168.202.1@tcp:35:bash.0 Request processed in 590us (1237us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788390438.340431:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00010000:00010000:2.0:1788390438.349714:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390438.418174:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.418393:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093798528 00000100:00100000:1.0:1788390438.418403:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093798528 00000100:00100000:1.0:1788390438.418461:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1788390438.418472:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11376:x1875263093798528:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390438.418498:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.418518:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd326af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecd0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390438.418626:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788390438.418740:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd326af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecd0 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.418755:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:1.0:1788390438.418758:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390438.418763:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd326af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecd0 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.418777:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390438.418839:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:11376:x1875263093798528:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 369us (683us total) trans 4294967417 rc 301/301 00000100:00100000:1.0:1788390438.418846:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1788390438.429748:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.429831:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093798784 00000100:00100000:0.0:1788390438.429841:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093798784 00000100:00100000:0.0:1788390438.429912:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788390438.429922:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:11376:x1875263093798784:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390438.430172:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11376:x1875263093798784:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 251us (433us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788390438.430179:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788390438.492428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.493146:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093798912 00000100:00100000:0.0:1788390438.493161:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093798912 00000100:00100000:0.0:1788390438.493532:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1788390438.493549:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11382:x1875263093798912:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390438.493587:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390438.493614:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecd7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.493793:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.493813:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.493847:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390438.493894:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788390438.493898:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390438.493919:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.493953:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecd7 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.494005:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecd7 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.494016:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390438.494019:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390438.494024:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb800, rc 0) 00000100:00100000:0.0:1788390438.494158:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11382:x1875263093798912:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 614us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390438.494167:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:2.0:1788390438.498518:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.500373:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799168 00000100:00100000:1.0:1788390438.500397:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799168 00000100:00100000:1.0:1788390438.500526:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1788390438.500540:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11382:x1875263093799168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390438.500570:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.500600:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd326cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecde expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.500763:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd326d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.500780:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd326d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.500814:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd326d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390438.500830:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788390438.501185:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd326cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecde expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.501218:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd326d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecde expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.501228:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:1.0:1788390438.501231:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390438.501235:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390438.501403:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:11382:x1875263093799168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 866us (2898us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788390438.501412:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1788390438.505020:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.505066:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.505139:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799296 00000100:00100000:0.0:1788390438.505152:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799296 00000100:00100000:0.0:1788390438.505250:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390438.505272:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:2356:x1875263093799296:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390438.505297:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390438.505330:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd326d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecde expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.505388:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:0.0:1788390438.505393:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390438.505458:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:2356:x1875263093799296:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 198us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390438.505466:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390438.505625:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799552 00000100:00100000:3.0:1788390438.505631:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799552 00000100:00100000:3.0:1788390438.505672:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:3.0:1788390438.505680:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11382:x1875263093799552:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390438.506628:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390438.506660:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd326e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfece5 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.506833:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.506850:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.506864:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390438.506879:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788390438.507142:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd326e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfece5 expref: 27 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.507163:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfece5 expref: 26 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.507172:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:3.0:1788390438.507175:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390438.507178:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390438.507300:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11382:x1875263093799552:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1619us (2294us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788390438.507309:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:1.0:1788390438.512332:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390438.512460:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799680 00000100:00100000:3.0:1788390438.512476:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799680 00000100:00100000:3.0:1788390438.512590:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788390438.512604:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093799680:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1788390438.512672:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.512697:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.512706:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390438.512710:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390438.512715:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.512762:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390438.512792:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 6 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390438.512811:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103238016:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390438.512931:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390438.515153:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103238016:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390438.515166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390438.515195:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.515250:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799808 00000100:00100000:0.0:1788390438.515263:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799808 00002000:00100000:0.0:1788390438.515328:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff95d687861500 x1875263093799808/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:54/0 lens 504/0 e 0 to 0 dl 1788390449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390438.515339:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861500 with x1875263093799808 ext(0->12) 00010000:00010000:0.0:1788390438.515347:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 7 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.515373:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 7 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390438.515382:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687861500 00000100:00100000:0.0:1788390438.515419:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390438.515432:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093799808:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:0.0:1788390438.516645:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093799808:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1209us (1479us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788390438.516665:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:0.0:1788390438.516675:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff95d687861500 x1875263093799808/t4294967305(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:54/0 lens 504/448 e 0 to 0 dl 1788390449 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390438.516684:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861500 with x1875263093799808 ext(0->12) 00010000:00010000:0.0:1788390438.516693:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.516707:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390438.516715:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687861500 00000100:00100000:3.0:1788390438.518682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390438.519229:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093799936 00000100:00100000:2.0:1788390438.519244:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093799936 00010000:00010000:2.0:1788390438.519306:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390438.519367:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788390438.519380:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093799936:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390438.519398:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788390438.519424:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788390438.519428:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788390438 00002000:00010000:2.0:1788390438.519430:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788390438 00002000:00010000:2.0:1788390438.519432:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788390438 00010000:00010000:2.0:1788390438.519439:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.519456:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.519487:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd326a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecc9 expref: 9 pid: 6653 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.519506:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390438.519511:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390438.519537:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.519547:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.519591:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390438.519661:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093799936:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 284us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390438.519669:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00010000:00010000:1.0:1788390438.519897:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.519908:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.519941:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.519987:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.519997:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.520005:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390438.520010:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.520021:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.520036:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.520044:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd326f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.520122:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093799680:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 7520us (7917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.520130:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1788390438.522631:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.522829:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093800192 00000100:00100000:0.0:1788390438.522842:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093800192 00000100:00100000:0.0:1788390438.522953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788390438.523008:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b335f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11382:x1875263093800192:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:0.0:1788390438.523095:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfece5 expref: 26 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390438.523460:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967421 00000001:00080000:0.0:1788390438.523496:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000001:00080000:0.0:1788390438.524132:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00010000:00010000:0.0:1788390438.524205:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.524225:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.524250:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.524302:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.524320:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 30 pid: 5805 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.524339:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103238144:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390438.524465:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390438.528876:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.529019:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093800320 00000100:00100000:1.0:1788390438.529031:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093800320 00010000:00010000:1.0:1788390438.529108:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 31 pid: 5805 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.529154:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788390438.529166:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:2356:x1875263093800320:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390438.529186:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390438.529195:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 31 pid: 5805 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.529221:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 31 pid: 5805 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.529251:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:1.0:1788390438.529263:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.529275:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.529284:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.529310:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390438.529394:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:2356:x1875263093800320:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 230us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.529403:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00010000:00010000:0.0:1788390438.530855:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecbb expref: 30 pid: 5805 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.530881:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1875263103238144:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390438.530911:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.530920:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.530924:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390438.531116:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788390438.531574:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000100:00100000:0.0:1788390438.531729:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103238272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788390438.531832:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390438.531918:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390438.532176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103238272 00000100:00100000:2.0:1788390438.532185:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103238272 00000100:00100000:2.0:1788390438.532330:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390438.532343:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103238272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390438.532454:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103238272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390438.532462:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390438.532572:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103238272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788390438.533145:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000100:00100000:1.0:1788390438.533237:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103238400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788390438.533284:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390438.533303:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390438.533527:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103238400 00000100:00100000:2.0:1788390438.533535:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103238400 00000100:00100000:2.0:1788390438.533579:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390438.533589:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1875263103238400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390438.533788:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1875263103238400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (504us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788390438.533796:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390438.534150:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1875263103238400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788390438.534226:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788390438.534401:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534412:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534421:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534426:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390438.534431:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534439:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534458:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:1.0:1788390438.534461:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788390438.534467:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.534474:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd326fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390438.534692:0:5809:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788390438.534815:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788390438.534846:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255641884116ns, next at 256641880565ns, rc = 0 00000001:00080000:1.0:1788390438.534853:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:1.0:1788390438.534894:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23600) 00010000:00010000:1.0:1788390438.534898:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788390438.534906:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd326e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfece5 expref: 34 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.535081:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b335f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:11382:x1875263093800192:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 12077us (12463us total) trans 4294967429 rc 0/0 00000100:00100000:1.0:1788390438.535091:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000020:00080000:1.0:1788390438.535095:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788390438.536924:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390438.537896:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.538006:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093800448 00000100:00100000:0.0:1788390438.538019:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093800448 00000100:00100000:0.0:1788390438.538082:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1788390438.538092:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:11382:x1875263093800448:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390438.538121:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390438.538148:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.538230:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecec expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.538247:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecec expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.538273:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390438.538277:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390438.538281:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:0.0:1788390438.538343:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11382:x1875263093800448:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 252us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390438.538351:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1788390438.541610:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.541734:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093800704 00000100:00100000:0.0:1788390438.541748:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093800704 00000100:00100000:0.0:1788390438.541825:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390438.541839:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11382:x1875263093800704:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390438.542415:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11382:x1875263093800704:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 578us (817us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1788390438.542435:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788390438.621314:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.621918:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093800960 00000100:00100000:0.0:1788390438.621932:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093800960 00000100:00100000:0.0:1788390438.622039:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:0.0:1788390438.622053:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11392:x1875263093800960:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390438.622090:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390438.622116:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3270a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecf3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390438.622241:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788390438.622404:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3270a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecf3 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.622422:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:0.0:1788390438.622425:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390438.622431:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3270a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecf3 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.622447:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788390438.622531:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11392:x1875263093800960:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 481us (1233us total) trans 4294967431 rc 301/301 00000100:00100000:0.0:1788390438.622538:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1788390438.626406:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.626598:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093801088 00000100:00100000:0.0:1788390438.626614:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093801088 00000100:00100000:0.0:1788390438.626853:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:0.0:1788390438.626868:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11392:x1875263093801088:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788390438.627037:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627056:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627070:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627090:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627096:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627102:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627379:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627389:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627396:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390438.627450:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627466:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627485:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627493:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627499:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.627503:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627511:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627526:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390438.627529:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.627534:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627540:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627553:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627558:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627564:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627568:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.627577:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627583:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627591:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390438.627594:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.627596:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627601:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3271f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627617:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627622:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627627:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627632:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.627635:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627641:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627648:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390438.627650:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.627660:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.627666:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd32726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390438.627782:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11392:x1875263093801088:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 915us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390438.627791:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:2.0:1788390438.630586:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.630701:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093801344 00000100:00100000:1.0:1788390438.630770:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093801344 00000100:00100000:1.0:1788390438.630869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1788390438.630882:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11392:x1875263093801344:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390438.631371:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11392:x1875263093801344:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 490us (798us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788390438.631380:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788390438.671669:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.671777:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093801600 00000100:00100000:0.0:1788390438.671789:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093801600 00000100:00100000:0.0:1788390438.671867:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:0.0:1788390438.671880:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11395:x1875263093801600:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390438.671913:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390438.671940:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd3272d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfecfa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672097:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672116:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672130:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672148:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672156:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672194:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672372:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672382:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672389:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390438.672401:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788390438.672533:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672541:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672549:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672556:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.672561:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672569:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672594:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390438.672597:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.672610:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672618:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672633:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672640:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672647:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672651:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.672655:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672661:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672669:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390438.672672:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.672675:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672681:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3273b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672732:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd3272d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672760:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.672768:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390438.672770:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390438.672773:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788390438.672855:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11395:x1875263093801600:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 977us (1202us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788390438.672865:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:2.0:1788390438.677364:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.682552:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093801728 00000100:00100000:1.0:1788390438.682584:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093801728 00000100:00100000:1.0:1788390438.682687:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:1.0:1788390438.682700:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11395:x1875263093801728:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1788390438.682793:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682814:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682850:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682887:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682895:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682902:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682909:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390438.682914:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682921:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682935:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390438.682938:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390438.682943:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.682948:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.683078:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11395:x1875263093801728:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 380us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.683086:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:2.0:1788390438.687105:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.687289:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093801984 00000100:00100000:0.0:1788390438.687303:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093801984 00000100:00100000:0.0:1788390438.687394:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390438.687407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11395:x1875263093801984:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390438.687777:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11395:x1875263093801984:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 371us (686us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788390438.687786:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390438.873240:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390438.873295:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093802240 00000100:00100000:0.0:1788390438.873309:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093802240 00000100:00100000:2.0:1788390438.874032:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:2.0:1788390438.874050:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11426:x1875263093802240:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788390438.874087:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390438.874117:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed01 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.874249:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3275e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.874267:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.874281:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390438.874295:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788390438.874612:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed01 expref: 43 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.874634:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed01 expref: 42 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.874644:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390438.874648:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390438.874652:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:2.0:1788390438.874779:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11426:x1875263093802240:12345-192.168.202.1@tcp:101:cat.0 Request processed in 732us (1557us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788390438.874787:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:0.0:1788390438.878329:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.878387:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093802496 00000100:00100000:1.0:1788390438.878408:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093802496 00000100:00100000:1.0:1788390438.878479:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788390438.878495:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11426:x1875263093802496:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1788390438.878800:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:11426:x1875263093802496:12345-192.168.202.1@tcp:35:cat.0 Request processed in 311us (481us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788390438.878809:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788390438.879712:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.879747:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093802624 00000100:00100000:1.0:1788390438.879754:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093802624 00000100:00100000:1.0:1788390438.879807:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390438.879817:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:2356:x1875263093802624:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390438.879831:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390438.879860:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3275e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed01 expref: 43 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.879883:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390438.879889:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390438.880573:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:2356:x1875263093802624:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 756us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390438.880580:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000001:00080000:2.0:1788390438.901321:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788390438.901459:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788390438.901822:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:1.0:1788390438.901856:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788390438.901878:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b326ca80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788390438.901883:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68a6e3f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b326c480 00000020:00080000:1.0:1788390438.901887:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68a6e3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d68f72ac00 00000020:00080000:1.0:1788390438.901923:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788390438.902130:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788390438.902291:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788390438.902494:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103238528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788390438.902571:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390438.902879:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103238528 00000100:00100000:0.0:1788390438.902888:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103238528 00000100:00100000:0.0:1788390438.902946:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788390438.906313:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103238528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788390438.906373:0:6652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788390438.906435:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a98ac26, atime: 0x6a98ac26, ctime: 0x6a98ac26, blocks: 0xb 00010000:00010000:0.0:1788390438.906444:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.906462:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1788390438.906467:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390438.906473:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.906490:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.906501:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.906511:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.906538:0:6652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390438.906578:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390438.906586:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.906594:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390438.906599:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.906607:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.906624:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.906631:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a97762/0x9aafc5f04cd3276c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.906653:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390438.906655:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390438.906656:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390438.907107:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103238528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4138us (4523us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788390438.907116:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390438.907126:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788390438.907132:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788390438.907155:0:3288:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d68f5aa680 x1875263103238528/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788390454 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788390438.907167:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68f5aa680/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788390438.907173:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103238528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390438.917944:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390438.918190:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093802880 00000100:00100000:1.0:1788390438.918201:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093802880 00000100:00100000:1.0:1788390438.918266:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:1.0:1788390438.918278:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11432:x1875263093802880:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788390438.918303:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390438.918307:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390438.918332:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd326c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecd7 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918361:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390438.918366:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390438.918380:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32773 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed08 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918479:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918495:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918511:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918544:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390438.918558:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 19 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390438.918571:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103238656:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390438.918671:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390438.923019:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390438.923065:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093803008 00000100:00100000:2.0:1788390438.923074:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093803008 00000100:00100000:0.0:1788390438.923111:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103238656:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390438.923114:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 20 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.923135:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390438.923228:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788390438.923238:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:2356:x1875263093803008:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390438.923252:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390438.923260:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 20 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923271:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 20 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923293:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecfa expref: 20 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923308:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390438.923313:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923322:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923330:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.923362:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390438.923385:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.923397:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390438.923414:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1788390438.923416:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:2356:x1875263093803008:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 180us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390438.923423:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:0.0:1788390438.923855:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32773 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.923872:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.923881:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390438.923883:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390438.923886:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:0.0:1788390438.923986:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11432:x1875263093802880:12345-192.168.202.1@tcp:101:dd.0 Request processed in 5710us (6051us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788390438.923994:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:1.0:1788390438.927721:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390438.927801:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093803264 00000100:00100000:2.0:1788390438.927825:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093803264 00000100:00100000:2.0:1788390438.927884:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:2.0:1788390438.927894:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11432:x1875263093803264:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:2.0:1788390438.928203:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.928218:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390438.928226:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390438.928266:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967438 00000004:00010000:2.0:1788390438.928289:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b8c1e41 reply state 00000000945d1e07 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390438.928298:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390438.928382:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11432:x1875263093803264:12345-192.168.202.1@tcp:36:dd.0 Request processed in 486us (665us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788390438.928390:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000020:00080000:2.0:1788390438.928394:0:8163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788390438.929538:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929550:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929556:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929559:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390438.929563:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929583:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929596:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390438.929598:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390438.929601:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390438.929605:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.101625:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.101846:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093803392 00000100:00100000:2.0:1788390439.101855:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093803392 00000100:00100000:2.0:1788390439.101916:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1788390439.101928:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:11446:x1875263093803392:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:2.0:1788390439.101995:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.102013:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3278f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed0f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102071:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102095:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102105:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102126:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102130:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102134:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102451:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102460:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102465:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102494:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.102509:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 22 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390439.102533:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103238784:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390439.102623:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390439.104558:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103238784:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390439.104586:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.105770:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.106093:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093803648 00000100:00100000:0.0:1788390439.106102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093803648 00000100:00100000:0.0:1788390439.106174:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788390439.106185:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:5588:x1875263093803648:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788390439.106515:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:5588:x1875263093803648:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 330us (747us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788390439.106523:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788390439.110519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.110723:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093803776 00000100:00100000:1.0:1788390439.110732:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093803776 00010000:00010000:1.0:1788390439.110769:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 24 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.110875:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1788390439.111174:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:2357:x1875263093803776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390439.111188:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390439.111194:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 24 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111228:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 24 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111250:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd3277a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed08 expref: 24 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111266:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.111270:0:11126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111276:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111281:0:11126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.111334:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390439.111382:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111390:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.111404:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:2357:x1875263093803776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 297us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.111412:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000004:00200000:2.0:1788390439.111436:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788390439.111441:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390439.111463:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111475:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111681:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111689:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111696:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111701:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390439.111712:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111719:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111728:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390439.111731:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390439.111735:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111741:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111751:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111757:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111762:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111917:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390439.111921:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111928:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111937:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d68641eb00) 00010000:00010000:2.0:1788390439.111940:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390439.111950:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.111957:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3279d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.112169:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd3278f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed0f expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.112185:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed0f expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.112192:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390439.112204:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390439.112207:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:2.0:1788390439.112260:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11446:x1875263093803392:12345-192.168.202.1@tcp:101:stat.0 Request processed in 10334us (10644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.112268:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:3.0:1788390439.160559:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.161220:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093804032 00000100:00100000:0.0:1788390439.161231:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093804032 00000100:00100000:0.0:1788390439.161294:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:0.0:1788390439.161304:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11452:x1875263093804032:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:0.0:1788390439.161376:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390439.161405:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd327a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed0f expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.161426:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390439.161442:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390439.161673:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.161686:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.161707:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390439.161754:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1788390439.161776:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c683204 reply state 00000000d6ecf700 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390439.161785:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390439.161884:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11452:x1875263093804032:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 580us (1337us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788390439.161891:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000020:00080000:0.0:1788390439.161897:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390439.170761:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170789:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170797:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170802:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390439.170807:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170814:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170848:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:3.0:1788390439.170851:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390439.170856:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.170862:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd327ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390439.237172:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.238423:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093804160 00000100:00100000:0.0:1788390439.238436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093804160 00000100:00100000:0.0:1788390439.238573:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:0.0:1788390439.238585:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11466:x1875263093804160:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1788390439.238610:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390439.238631:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd327b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed16 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238711:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238725:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238751:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238766:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238773:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.238789:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239097:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239114:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239121:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390439.239158:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788390439.239162:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390439.239182:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239193:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239201:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239217:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239223:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239228:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390439.239233:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239241:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239253:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390439.239256:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390439.239261:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239266:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd327b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239278:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239283:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239289:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239294:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390439.239302:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239308:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239316:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390439.239318:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390439.239321:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239327:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239369:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd327b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239381:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.239388:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390439.239390:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390439.239392:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:0.0:1788390439.242488:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11466:x1875263093804160:12345-192.168.202.1@tcp:101:stat.0 Request processed in 3891us (5311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390439.242503:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:0.0:1788390439.318515:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.318918:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093804416 00000100:00100000:2.0:1788390439.318932:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093804416 00000100:00100000:2.0:1788390439.319154:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:2.0:1788390439.319165:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11476:x1875263093804416:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390439.319189:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.319213:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd327ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed1d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390439.319333:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788390439.319494:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd327ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed1d expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.319526:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:2.0:1788390439.319529:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390439.319533:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd327ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed1d expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.319546:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:2.0:1788390439.319647:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:11476:x1875263093804416:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 484us (1147us total) trans 4294967443 rc 301/301 00000100:00100000:2.0:1788390439.319653:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:1.0:1788390439.322242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.322364:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093804672 00000100:00100000:0.0:1788390439.322376:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093804672 00000100:00100000:0.0:1788390439.322481:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788390439.322511:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6ae0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:11476:x1875263093804672:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390439.322812:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6ae0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11476:x1875263093804672:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 303us (854us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788390439.322821:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00010000:00010000:2.0:1788390439.373206:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390439.374314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.374402:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093804928 00000100:00100000:2.0:1788390439.374415:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093804928 00000100:00100000:2.0:1788390439.374485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:2.0:1788390439.374494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11482:x1875263093804928:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390439.374522:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.374544:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd327dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed24 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.374662:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.374680:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.374690:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.374754:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.374767:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 27 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390439.374781:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103238912:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390439.374875:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390439.377194:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103238912:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390439.377231:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390439.378082:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.378156:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093805056 00000100:00100000:1.0:1788390439.378167:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093805056 00010000:00010000:1.0:1788390439.378215:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 28 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.378262:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1788390439.378273:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:2356:x1875263093805056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390439.378312:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390439.378320:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 28 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378335:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 28 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378372:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd327c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed16 expref: 28 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378392:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.378398:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378410:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378418:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.378512:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390439.378586:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:2356:x1875263093805056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 314us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.378595:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00010000:00010000:0.0:1788390439.379467:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.379479:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390439.379506:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788390439.379898:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd327dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.379915:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.379936:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.379938:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390439.379940:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93000, rc 0) 00000100:00100000:1.0:1788390439.380030:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:11482:x1875263093804928:12345-192.168.202.1@tcp:101:bash.0 Request processed in 5534us (5724us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788390439.380040:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1788390439.384151:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.384284:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093805312 00000100:00100000:1.0:1788390439.384297:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093805312 00000100:00100000:1.0:1788390439.384388:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1788390439.384401:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:11482:x1875263093805312:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1788390439.384745:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.384767:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.384780:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390439.384835:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788390439.384860:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e0edb02 reply state 00000000a94748a0 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.384870:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390439.385245:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:11482:x1875263093805312:12345-192.168.202.1@tcp:36:bash.0 Request processed in 844us (1107us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788390439.385253:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000020:00080000:1.0:1788390439.385277:0:8163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390439.387940:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388064:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388075:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388082:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.388087:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388097:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388119:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.388127:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.388133:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.388140:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd327f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390439.391663:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.391738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093805440 00000100:00100000:0.0:1788390439.391753:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093805440 00000100:00100000:0.0:1788390439.391849:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:0.0:1788390439.391863:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:11482:x1875263093805440:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390439.391896:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390439.391923:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd327f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed2b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.392365:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.392384:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 30 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.392394:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.392444:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 30 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.392479:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 30 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390439.392497:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103239040:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390439.392621:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390439.396364:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.396722:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093805568 00000100:00100000:2.0:1788390439.396736:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093805568 00010000:00010000:2.0:1788390439.396791:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 31 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390439.396844:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788390439.396856:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:2356:x1875263093805568:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390439.396874:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390439.396882:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 31 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.396897:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 31 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.397012:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390439.397018:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.397029:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.397037:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.397059:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390439.397126:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:2356:x1875263093805568:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 272us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.397134:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00010000:00010000:1.0:1788390439.398532:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd327e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed24 expref: 30 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.398563:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103239040:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390439.398597:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.398636:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.398644:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.399157:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788390439.399163:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390439.399195:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.399267:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd327f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed2b expref: 30 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.399287:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed2b expref: 29 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.399298:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.399301:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390439.399305:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fac00, rc 0) 00000100:00100000:1.0:1788390439.399407:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:11482:x1875263093805440:12345-192.168.202.1@tcp:101:bash.0 Request processed in 7546us (7754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.399418:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:0.0:1788390439.401889:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.402005:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093805824 00000100:00100000:1.0:1788390439.402019:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093805824 00000100:00100000:1.0:1788390439.402079:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788390439.402090:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:11482:x1875263093805824:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1788390439.402460:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:11482:x1875263093805824:12345-192.168.202.1@tcp:35:bash.0 Request processed in 370us (582us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788390439.402485:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788390439.468064:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.468360:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806080 00000100:00100000:2.0:1788390439.468374:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806080 00000100:00100000:2.0:1788390439.468453:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1788390439.468466:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+30:11492:x1875263093806080:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390439.468500:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.468526:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed32 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390439.468656:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788390439.469176:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32806 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed32 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.469195:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:2.0:1788390439.469218:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390439.469766:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed32 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.469789:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:2.0:1788390439.469885:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11492:x1875263093806080:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1420us (1832us total) trans 4294967449 rc 301/301 00000100:00100000:2.0:1788390439.469894:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1788390439.475562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.476057:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806208 00000100:00100000:1.0:1788390439.476071:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806208 00000100:00100000:1.0:1788390439.476154:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1788390439.476165:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11492:x1875263093806208:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788390439.476264:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476283:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476296:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476311:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476318:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476323:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476677:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476686:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476691:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390439.476755:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476770:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476778:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476785:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476791:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.476797:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476805:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476818:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390439.476821:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.476825:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476831:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476842:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476845:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476856:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476859:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.476861:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476864:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476868:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5ad00) 00010000:00010000:1.0:1788390439.476869:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.476871:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476874:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3281b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476896:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476903:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476909:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476914:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.476917:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476932:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476937:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.476939:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.476941:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.476947:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.477101:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11492:x1875263093806208:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 935us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.477111:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:0.0:1788390439.479319:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.482470:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806464 00000100:00100000:1.0:1788390439.482491:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806464 00000100:00100000:1.0:1788390439.482571:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1788390439.482584:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11492:x1875263093806464:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390439.482885:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11492:x1875263093806464:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 302us (3577us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788390439.482894:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1788390439.515030:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.515141:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806720 00000100:00100000:1.0:1788390439.515158:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806720 00000100:00100000:1.0:1788390439.515249:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:1.0:1788390439.515785:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11495:x1875263093806720:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390439.515823:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390439.515917:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed39 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516057:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516075:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516088:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516106:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516114:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516119:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516499:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3283e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516507:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516513:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.516522:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788390439.516612:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516617:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516626:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516631:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.516634:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516639:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516650:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390439.516653:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.516656:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516660:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516671:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516674:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516677:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516681:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.516683:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516692:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.516697:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5ad00) 00010000:00010000:1.0:1788390439.516698:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.516700:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.518576:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.518691:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed39 expref: 35 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.518709:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed39 expref: 34 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.518719:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.518722:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390439.518725:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390439.519127:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11495:x1875263093806720:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3559us (3800us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788390439.519141:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1788390439.523042:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.523295:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806848 00000100:00100000:1.0:1788390439.523309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806848 00000100:00100000:1.0:1788390439.523385:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1788390439.523396:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11495:x1875263093806848:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1788390439.523517:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523538:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523552:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523587:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523595:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523604:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523610:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.523615:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523623:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523636:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:1.0:1788390439.523641:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390439.523645:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.523651:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd3284c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.523748:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11495:x1875263093806848:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 353us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.523758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788390439.524297:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.524360:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093806976 00000100:00100000:2.0:1788390439.524372:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093806976 00000100:00100000:2.0:1788390439.524427:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788390439.524438:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:2357:x1875263093806976:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390439.524453:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390439.524475:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3283e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed39 expref: 34 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.524491:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390439.524495:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390439.524537:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:2357:x1875263093806976:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.524545:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390439.530331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.533708:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093807232 00000100:00100000:1.0:1788390439.533730:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093807232 00000100:00100000:0.0:1788390439.534288:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788390439.534303:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+33:11495:x1875263093807232:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390439.534669:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11495:x1875263093807232:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 368us (4350us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788390439.534678:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788390439.626364:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.626688:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093807488 00000100:00100000:2.0:1788390439.626702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093807488 00000100:00100000:2.0:1788390439.626781:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788390439.626794:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11513:x1875263093807488:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788390439.626829:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.626856:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed40 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.627102:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3285a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.627121:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3285a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.627535:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3285a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390439.627553:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788390439.627726:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd32853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed40 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.627750:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3285a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed40 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.627760:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390439.627763:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788390439.627767:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:2.0:1788390439.627934:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11513:x1875263093807488:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1140us (1590us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788390439.627943:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788390439.644307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.644517:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093807616 00000100:00100000:1.0:1788390439.644531:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093807616 00000100:00100000:1.0:1788390439.644616:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788390439.644628:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11514:x1875263093807616:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390439.644659:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390439.644684:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed47 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.644773:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.644789:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.644803:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.644846:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788390439.644851:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390439.644871:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.644903:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed47 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.644954:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed47 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.645181:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390439.645184:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390439.645189:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390439.645284:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11514:x1875263093807616:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 657us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.645292:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1788390439.649874:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.649944:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808000 00000100:00100000:1.0:1788390439.649998:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808000 00000100:00100000:1.0:1788390439.650072:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788390439.650084:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11514:x1875263093808000:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390439.650525:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11514:x1875263093808000:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 442us (665us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788390439.650533:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1788390439.656410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.656550:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808128 00000100:00100000:2.0:1788390439.656564:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808128 00000100:00100000:2.0:1788390439.656654:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390439.656667:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11514:x1875263093808128:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:2.0:1788390439.656710:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788390439.656745:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd327ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed2b expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.656773:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3285a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed40 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.656788:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecec expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.656798:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:2.0:1788390439.656811:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390439.656883:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11514:x1875263093808128:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 218us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.656891:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390439.664702:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.664860:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808256 00000100:00100000:1.0:1788390439.664875:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808256 00000100:00100000:1.0:1788390439.665153:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:1.0:1788390439.665168:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11514:x1875263093808256:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1788390439.665335:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.665369:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.665407:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390439.665831:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788390439.666044:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11514:x1875263093808256:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 877us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.666054:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1788390439.698767:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.702826:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808384 00000100:00100000:0.0:1788390439.702848:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808384 00000100:00100000:0.0:1788390439.702933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:0.0:1788390439.702946:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11516:x1875263093808384:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390439.702993:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390439.703022:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3287d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed4e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703107:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703149:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703163:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703181:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703189:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703195:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703560:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703571:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703579:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390439.703623:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788390439.703628:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390439.703651:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703666:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703686:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703693:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703700:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703707:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390439.703713:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703722:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703737:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390439.703740:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390439.703745:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703751:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703766:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703772:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703778:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703790:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390439.703793:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703800:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703808:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390439.703811:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390439.703813:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703819:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3288b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703856:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3287d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703871:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 36 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.703879:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:0.0:1788390439.703881:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390439.703884:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:0.0:1788390439.704016:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11516:x1875263093808384:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1071us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390439.704025:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000040:00080000:0.0:1788390439.821318:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390439.821335:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390439.821408:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788390439.821416:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390439.821573:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103239168:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390439.821706:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390439.830320:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103239168:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390439.831320:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.831400:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808512 00000100:00100000:2.0:1788390439.831410:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808512 00000100:00100000:2.0:1788390439.831480:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:2.0:1788390439.831492:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11527:x1875263093808512:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390439.831534:0:5805:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390439.831732:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11527:x1875263093808512:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 240us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.831740:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1788390439.840762:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.840856:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808640 00000100:00100000:1.0:1788390439.840869:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808640 00000100:00100000:1.0:1788390439.840941:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:1.0:1788390439.840953:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11527:x1875263093808640:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.841076:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841097:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841112:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841131:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841138:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841144:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841175:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841194:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841201:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.841254:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788390439.841260:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390439.841275:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841287:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841294:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841301:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841308:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.841312:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841321:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841334:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788390439.841338:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.841354:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841370:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32899 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841382:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841388:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841393:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841398:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.841401:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841407:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841414:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff95d683b5a000) 00010000:00010000:1.0:1788390439.841416:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.841419:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841424:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd328a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841443:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841449:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841459:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841464:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.841467:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841473:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841479:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:1.0:1788390439.841482:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.841484:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.841490:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd328a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.841570:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11527:x1875263093808640:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 618us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.841579:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1788390439.846799:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.846888:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093808896 00000100:00100000:1.0:1788390439.846901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093808896 00000100:00100000:1.0:1788390439.846991:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:1.0:1788390439.847005:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11527:x1875263093808896:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.847034:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390439.847062:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed55 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847212:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847230:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847245:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.847260:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788390439.847399:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847407:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847413:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847420:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.847424:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847433:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847448:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:1.0:1788390439.847452:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390439.847459:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847477:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847525:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328ae lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed55 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847536:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788390439.847539:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390439.847543:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed55 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.847555:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390439.847628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093808896:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 626us (843us total) trans 4294967455 rc 301/301 00000100:00100000:1.0:1788390439.847637:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:3.0:1788390439.850281:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.850386:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093809024 00000100:00100000:0.0:1788390439.850398:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093809024 00000100:00100000:0.0:1788390439.850476:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:0.0:1788390439.850489:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093809024:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390439.850539:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390439.850675:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093809024:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 189us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390439.850683:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:1.0:1788390439.854276:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390439.854364:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093809280 00000100:00100000:3.0:1788390439.854378:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093809280 00000100:00100000:3.0:1788390439.854446:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1788390439.854472:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093809280:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390439.854501:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390439.854504:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390439.854539:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd3286f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed47 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.854559:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788390439.854565:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390439.854583:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd328c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed5c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390439.855473:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788390439.855780:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd328ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.855798:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd328ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.855811:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd328ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.855882:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd328c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed5c expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.855899:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd328ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed5c expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.855909:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788390439.855912:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390439.855922:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390439.856034:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11527:x1875263093809280:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1564us (1771us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788390439.856043:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:0.0:1788390439.863700:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.863808:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093809536 00000100:00100000:1.0:1788390439.863821:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093809536 00000100:00100000:1.0:1788390439.863894:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:1.0:1788390439.863907:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11527:x1875263093809536:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.864017:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390439.864051:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd328ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed5c expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864075:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:1.0:1788390439.864090:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390439.864128:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864144:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864156:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864172:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864179:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864186:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864449:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864458:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864465:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864471:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.864476:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864485:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864505:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390439.864508:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.864513:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864519:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864529:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864535:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864540:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864544:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390439.864547:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864553:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864560:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7c2818b5 (ffff95d683b5a000) 00010000:00010000:1.0:1788390439.864562:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390439.864565:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.864571:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c2818b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.864683:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093809536:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 779us (997us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390439.864691:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:0.0:1788390439.867291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390439.867399:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093809664 00000100:00100000:3.0:1788390439.867412:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093809664 00000100:00100000:3.0:1788390439.867523:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:3.0:1788390439.867537:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11527:x1875263093809664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390439.867566:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390439.867598:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd328e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed63 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867645:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867662:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867677:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867803:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd328e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867827:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.867838:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390439.867841:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390439.867852:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390439.867928:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11527:x1875263093809664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 394us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390439.867937:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:0.0:1788390439.873549:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.873637:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093809920 00000100:00100000:1.0:1788390439.873650:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093809920 00000100:00100000:1.0:1788390439.873759:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:1.0:1788390439.873773:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11527:x1875263093809920:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.873913:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.873934:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.873948:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390439.874336:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788390439.874360:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256981398003ns, next at 257981394888ns, rc = 0 00000004:00010000:1.0:1788390439.874473:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013e1c0ff reply state 0000000048d1e560 transno 4294967457 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390439.874485:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390439.874603:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11527:x1875263093809920:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 832us (1067us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788390439.874612:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00010000:00010000:3.0:1788390439.879615:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879640:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879649:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879656:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390439.879662:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879670:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879692:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390439.879695:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390439.879700:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.879707:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd328f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390439.879943:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.880042:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810048 00000100:00100000:1.0:1788390439.880056:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810048 00000100:00100000:1.0:1788390439.880121:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:1.0:1788390439.880145:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11527:x1875263093810048:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.880172:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390439.880190:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed6a expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.880265:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 40 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.880280:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 40 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.880301:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:1.0:1788390439.880303:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390439.880305:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390439.880374:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11527:x1875263093810048:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.880381:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:2.0:1788390439.885320:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.885405:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810176 00000100:00100000:1.0:1788390439.885419:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810176 00000100:00080000:2.0:1788390439.885479:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390439.885511:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788390439.885525:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093810176:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788390439.885945:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093810176:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 422us (638us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788390439.885954:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1788390439.888503:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.888612:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810432 00000100:00100000:1.0:1788390439.888624:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810432 00000100:00100000:1.0:1788390439.888695:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1788390439.888707:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11527:x1875263093810432:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390439.889002:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11527:x1875263093810432:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 296us (511us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788390439.889011:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1788390439.890830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390439.890927:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810688 00000100:00100000:3.0:1788390439.890938:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810688 00000100:00100000:3.0:1788390439.891031:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1788390439.891044:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11527:x1875263093810688:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390439.891177:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11527:x1875263093810688:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 136us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390439.891184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:2.0:1788390439.893072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.893173:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810816 00000100:00100000:1.0:1788390439.893183:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810816 00000100:00100000:1.0:1788390439.893245:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:1.0:1788390439.893256:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11527:x1875263093810816:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390439.893279:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390439.893317:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed71 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893413:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893431:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893444:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390439.893488:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390439.893507:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893537:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed71 expref: 43 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893591:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed71 expref: 42 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390439.893601:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:1.0:1788390439.893604:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390439.893609:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390439.893735:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11527:x1875263093810816:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 480us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390439.893742:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:0.0:1788390439.897949:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390439.898440:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093810944 00000100:00100000:2.0:1788390439.898453:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093810944 00000100:00100000:2.0:1788390439.898524:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788390439.898538:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093810944:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390439.898572:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390439.898603:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed78 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390439.898639:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac28, blocks: 0x1 00010000:00010000:2.0:1788390439.898664:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1788390439.898669:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390439.898682:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 8 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.898706:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 8 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.898723:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93600, rc 0) 00000100:00100000:2.0:1788390439.898808:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093810944:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 272us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.898825:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788390439.901109:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390439.901297:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811200 00000100:00100000:3.0:1788390439.901381:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811200 00000100:00100000:3.0:1788390439.901489:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1788390439.901502:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11527:x1875263093811200:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390439.901640:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11527:x1875263093811200:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 141us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390439.901649:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1788390439.903721:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.905759:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811328 00000100:00100000:0.0:1788390439.905779:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811328 00000100:00100000:0.0:1788390439.905862:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1788390439.905876:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:11527:x1875263093811328:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390439.905899:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390439.905923:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed7f expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.905999:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 9 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390439.906011:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390439.906016:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390439.906022:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.906140:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 9 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.906156:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 9 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390439.906180:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103239296:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390439.906505:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390439.909687:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103239296:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390439.909687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788390439.909732:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390439.909760:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fae00, rc 0) 00000100:00100000:3.0:1788390439.910020:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811456 00000100:00100000:3.0:1788390439.910029:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811456 00010000:00010000:3.0:1788390439.910087:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 10 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390439.910137:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390439.910149:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2357:x1875263093811456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390439.910371:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390439.910418:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 10 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.910439:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 10 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.910517:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32910 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed78 expref: 10 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.910539:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390439.910547:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390439.910559:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.910572:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390439.910615:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390439.910791:0:5794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d692259f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1875263103239424:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390439.910937:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:11527:x1875263093811328:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5060us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.910945:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788390439.912761:0:5794:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390439.916032:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390439.916032:0:5794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d692259f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1875263103239424:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390439.916065:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390439.916118:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811584 00000100:00100000:3.0:1788390439.916127:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811584 00000100:00100000:0.0:1788390439.916149:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093811456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6002us (6470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390439.916161:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00002000:00100000:3.0:1788390439.916188:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff95d68f5ded80 x1875263093811584/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:55/0 lens 504/0 e 0 to 0 dl 1788390450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390439.916210:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5ded80 with x1875263093811584 ext(0->8) 00002000:00010000:3.0:1788390439.916216:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5ded80 00000100:00100000:3.0:1788390439.916253:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390439.916264:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093811584:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788390439.917499:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093811584:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 1228us (1470us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788390439.917511:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00100000:3.0:1788390439.917521:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff95d68f5ded80 x1875263093811584/t4294967314(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:55/0 lens 504/448 e 0 to 0 dl 1788390450 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390439.917531:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5ded80 with x1875263093811584 ext(0->8) 00002000:00010000:3.0:1788390439.917536:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5ded80 00000100:00100000:2.0:1788390439.919901:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.923541:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811712 00000100:00100000:1.0:1788390439.923563:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811712 00000100:00100000:1.0:1788390439.923692:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1788390439.923705:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11527:x1875263093811712:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788390439.969615:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:2.0:1788390439.969660:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1788390439.969672:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:2.0:1788390439.969873:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390439.969898:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103239552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788390439.970015:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788390439.970108:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788390439.970389:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103239552 00000100:00100000:0.0:1788390439.970398:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103239552 00000100:00100000:2.0:1788390439.970441:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11527:x1875263093811712:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 46735us (50549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390439.970454:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1788390439.970471:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390439.970484:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103239552:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788390439.970487:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788390439.970663:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788390439.970667:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788390440 00002000:00010000:0.0:1788390439.970670:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390439.970672:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788390440 -> 1788390440 00002000:00010000:0.0:1788390439.970675:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788390439.970724:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103239552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (710us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788390439.970739:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788390439.970940:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68f5df100/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788390439.970948:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103239552:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788390439.971040:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788390439.971052:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788390439.972646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390439.972720:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093811840 00000100:00100000:1.0:1788390439.972731:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093811840 00000100:00100000:1.0:1788390439.972795:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390439.972807:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093811840:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788390440.019006:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093811840:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 46188us (46359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.019023:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000001:00080000:3.0:1788390440.019069:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1788390440.019081:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788390440.019088:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1788390440.028692:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.030431:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812096 00000100:00100000:0.0:1788390440.030448:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812096 00000100:00100000:0.0:1788390440.030544:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1788390440.030559:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11527:x1875263093812096:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390440.030631:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390440.030666:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed71 expref: 18 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.030684:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788390440.030689:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390440.030727:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.030744:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.030755:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390440.031098:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c033a1d9 reply state 0000000027b5e965 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.031118:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1788390440.031362:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390440.031402:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11527:x1875263093812096:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 846us (2725us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788390440.031412:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00010000:00010000:0.0:1788390440.035546:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035570:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035578:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035584:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.035590:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035598:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035620:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788390440.035624:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.035630:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.035636:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3291e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.036538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.036595:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812224 00000100:00100000:2.0:1788390440.036610:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812224 00000100:00100000:2.0:1788390440.036692:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1788390440.036706:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093812224:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390440.037081:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788390440.037085:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788390440 -> 1788390439 00002000:00010000:2.0:1788390440.037088:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788390438 00002000:00010000:2.0:1788390440.037090:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788390440 -> 1788390439 00002000:00010000:2.0:1788390440.037092:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788390440.037162:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093812224:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 458us (631us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788390440.037170:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788390440.039316:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.039377:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812480 00000100:00100000:1.0:1788390440.039388:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812480 00000100:00100000:1.0:1788390440.039462:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:1.0:1788390440.039473:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11527:x1875263093812480:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788390440.039561:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.039588:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.039598:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.039643:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.039659:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 18 pid: 5805 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.039677:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103239680:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390440.039790:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390440.046069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.046109:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812608 00000100:00100000:1.0:1788390440.046120:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812608 00010000:00010000:1.0:1788390440.046176:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 19 pid: 5805 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.046230:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788390440.046243:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:2357:x1875263093812608:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390440.046263:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390440.046271:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 19 pid: 5805 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.046286:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 19 pid: 5805 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.046326:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:1.0:1788390440.046332:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.046355:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.046364:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.046389:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390440.046453:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:2357:x1875263093812608:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 212us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.046461:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00010000:00010000:2.0:1788390440.046606:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd328ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed63 expref: 18 pid: 5805 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.046624:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103239680:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390440.046647:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046659:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046666:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046722:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046730:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046738:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046744:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390440.046749:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046757:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046767:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788390440.046771:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788390440.046774:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.046780:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32925 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.046823:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:11527:x1875263093812480:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 7353us (7521us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788390440.046831:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:2.0:1788390440.052679:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390440.052875:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812736 00000100:00100000:3.0:1788390440.052887:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812736 00000100:00100000:3.0:1788390440.053033:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788390440.053047:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093812736:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788390440.053108:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.053133:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.053158:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390440.053163:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390440.053169:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.053391:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 8 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.053408:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 8 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.053426:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbfea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103239808:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390440.053529:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68451c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.057223:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390440.057263:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093812864 00000100:00100000:3.0:1788390440.057274:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093812864 00010000:00010000:3.0:1788390440.057328:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.057384:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1788390440.057395:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093812864:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390440.057413:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390440.057443:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.057479:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.057511:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390440.057517:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390440.057523:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.057533:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.057556:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390440.057615:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2356:x1875263093812864:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 222us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.057623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00010000:00010000:1.0:1788390440.058333:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed7f expref: 8 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.058360:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbfea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6650:1875263103239808:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390440.058386:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058398:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058405:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058449:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058458:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058466:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058473:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390440.058478:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058487:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058502:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.058509:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd3292c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.058587:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093812736:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5543us (5920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.058597:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788390440.061148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.061313:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093813120 00000100:00100000:1.0:1788390440.061323:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093813120 00000100:00100000:1.0:1788390440.061401:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:1.0:1788390440.061412:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+17:11527:x1875263093813120:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390440.061518:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061540:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061554:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061815:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061828:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 18 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061839:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061879:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 18 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.061895:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 18 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.061913:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103239936:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390440.062024:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390440.064491:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103239936:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390440.064530:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.064768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.065621:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093813248 00000100:00100000:1.0:1788390440.065632:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093813248 00010000:00010000:1.0:1788390440.065679:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 19 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.065776:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788390440.065794:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:2356:x1875263093813248:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390440.065812:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390440.065825:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 19 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065842:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 19 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065870:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd328fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed6a expref: 19 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065885:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:1.0:1788390440.065892:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065904:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065913:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.065953:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390440.066037:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:2356:x1875263093813248:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 245us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.066045:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00010000:00010000:3.0:1788390440.066168:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.066178:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390440.066419:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967460 00000001:00080000:3.0:1788390440.066591:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967461 00000001:00080000:3.0:1788390440.066638:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000100:00100000:3.0:1788390440.066733:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbfe8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103240064:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390440.066805:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390440.066841:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683389f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.066868:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240064 00000100:00100000:3.0:1788390440.066872:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240064 00000100:00100000:3.0:1788390440.066908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390440.066915:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1875263103240064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390440.067029:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1875263103240064:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.067036:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390440.067198:0:5807:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788390440.067204:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68f5df100, transno 4294967315 00000100:00100000:3.0:1788390440.067219:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbfe8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103240064:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788390440.067762:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000100:00100000:3.0:1788390440.067818:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbfe8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103240192:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390440.067853:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390440.067873:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683389840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.068086:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240192 00000100:00100000:3.0:1788390440.068093:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240192 00000100:00100000:3.0:1788390440.068125:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390440.068132:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1875263103240192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390440.068302:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1875263103240192:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (447us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788390440.068310:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390440.068333:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbfe8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5807:1875263103240192:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788390440.068379:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068389:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068396:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068410:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.068415:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068423:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068441:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788390440.068444:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390440.068449:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068455:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3293a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068487:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068493:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068499:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068503:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.068505:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068511:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068529:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:0.0:1788390440.068531:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390440.068534:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068539:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32876 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068561:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068577:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068587:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068616:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.068632:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 21 pid: 5806 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.068644:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103240320:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390440.068715:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390440.076004:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.076074:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f415c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103240320:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390440.076116:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.076486:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093813376 00000100:00100000:3.0:1788390440.076494:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093813376 00010000:00010000:3.0:1788390440.076540:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 22 pid: 5806 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.076589:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788390440.076600:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:2357:x1875263093813376:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390440.076619:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390440.076627:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 22 pid: 5806 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.076639:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 22 pid: 5806 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.077881:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd32892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed4e expref: 22 pid: 5806 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.077905:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:3.0:1788390440.077911:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.077924:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.077932:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.077977:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390440.078053:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:2357:x1875263093813376:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1452us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.078065:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00010000:00010000:3.0:1788390440.078239:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078253:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078270:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078277:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078285:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078291:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390440.078296:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078304:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078637:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:3.0:1788390440.078641:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390440.078646:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078653:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd32941 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078666:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078672:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078684:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078690:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390440.078693:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078700:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078708:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ad00) 00010000:00010000:3.0:1788390440.078711:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390440.078715:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.078721:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32933 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.078996:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11527:x1875263093813120:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 17583us (17855us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788390440.079006:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000020:00080000:3.0:1788390440.079010:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788390440.079137:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390440.079142:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390440.079576:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788390440.079584:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390440.082477:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.082562:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093813632 00000100:00100000:0.0:1788390440.082574:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093813632 00000100:00100000:0.0:1788390440.082633:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390440.082642:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6ae3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11527:x1875263093813632:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788390440.083318:0:5809:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788390440.083442:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00010000:00010000:0.0:1788390440.083491:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083511:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083525:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083540:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083547:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083553:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.083583:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788390440.083686:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6ae3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11527:x1875263093813632:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1042us (1221us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788390440.083696:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000020:00080000:0.0:1788390440.083701:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390440.083858:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390440.083867:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.083885:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390440.083890:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.083898:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.083913:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95d684d23400) 00010000:00010000:3.0:1788390440.083915:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390440.083921:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.083927:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd32948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.083943:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390440.083945:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390440.083947:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390440.290816:0:12464:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390440.290826:0:12464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390440.290871:0:12464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788390440.290880:0:12464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390440.389461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.389783:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093813888 00000100:00100000:0.0:1788390440.389798:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093813888 00000100:00100000:0.0:1788390440.389937:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:0.0:1788390440.389952:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:11537:x1875263093813888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390440.390137:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390440.390166:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3294f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed86 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.390298:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.390386:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.390402:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390440.390416:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788390440.390570:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3294f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed86 expref: 25 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.390589:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed86 expref: 24 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.390600:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390440.390604:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390440.390609:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb600, rc 0) 00000100:00100000:0.0:1788390440.390739:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11537:x1875263093813888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 789us (1292us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788390440.390748:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:0.0:1788390440.396165:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.396317:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093814016 00000100:00100000:1.0:1788390440.396330:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093814016 00000100:00100000:1.0:1788390440.396412:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1788390440.396427:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11537:x1875263093814016:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788390440.396527:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396543:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396554:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396565:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396570:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396574:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396828:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396833:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.396843:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390440.397570:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397596:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397602:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397610:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397616:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.397622:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397629:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397646:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.397650:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.397654:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397660:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32964 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397670:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397680:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397700:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397704:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.397707:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397714:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397723:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.397726:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.397729:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397734:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd3296b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397757:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397764:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397770:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397775:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.397783:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397789:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397797:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5a000) 00010000:00010000:1.0:1788390440.397800:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.397803:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.397808:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.397921:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11537:x1875263093814016:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1495us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.397931:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00010000:00010000:2.0:1788390440.398408:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390440.398730:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103240832:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.398796:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.398858:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390440.398865:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103240704:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.398905:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.398937:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240832 00000100:00100000:1.0:1788390440.398945:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240832 00000100:00100000:2.0:1788390440.399040:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103240448:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.399043:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240704 00000100:00100000:1.0:1788390440.399050:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240704 00000100:00100000:1.0:1788390440.399083:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390440.399093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.399097:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103240832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399127:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103240960:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.399160:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103240832:12345-0@lo:400:kworker.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.399171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.399183:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390440.399201:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390440.399210:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788390440.399212:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fe69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103240576:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.399223:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.399270:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103240704:12345-0@lo:400:kworker.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.399278:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788390440.399280:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390440.399292:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240576 00000100:00100000:1.0:1788390440.399297:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240576 00000100:00100000:2.0:1788390440.399299:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240960 00000100:00100000:2.0:1788390440.399305:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240960 00000100:00100000:1.0:1788390440.399317:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788390440.399325:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103240576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399366:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390440.399375:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103240576:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.399379:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103240960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.399388:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788390440.399439:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103240960:12345-0@lo:400:kworker.0 Request processed in 63us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.399448:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390440.399449:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103240704:0@lo:400:kworker.0 00000100:00100000:1.0:1788390440.399467:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103240832:0@lo:400:kworker.0 00000100:00080000:2.0:1788390440.399470:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390440.399495:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fe69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103240576:0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399509:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103240960:0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399545:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103240448 00000100:00100000:2.0:1788390440.399549:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103240448 00000100:00100000:2.0:1788390440.399632:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788390440.399642:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103240448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390440.399700:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3286:x1875263103240448:12345-0@lo:400:kworker.0 Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.399707:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788390440.401065:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103240448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390440.440650:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.440695:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093814272 00000100:00100000:1.0:1788390440.440708:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093814272 00000100:00100000:1.0:1788390440.440821:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:1.0:1788390440.440835:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11540:x1875263093814272:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390440.440863:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.440901:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed8d expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441014:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441047:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441061:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441077:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441084:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441090:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441440:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441449:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441457:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390440.441469:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788390440.441588:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441597:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441604:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441615:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.441626:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441634:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441649:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.441652:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.441657:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441663:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441673:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441678:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441683:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441688:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.441691:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441697:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441713:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5a000) 00010000:00010000:1.0:1788390440.441715:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.441718:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441723:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441775:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 27 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441790:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 26 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.441797:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.441800:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390440.441802:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63c00, rc 0) 00000100:00100000:1.0:1788390440.441878:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11540:x1875263093814272:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1046us (1238us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788390440.441887:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:2.0:1788390440.445647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.445693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093814400 00000100:00100000:1.0:1788390440.445704:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093814400 00000100:00100000:1.0:1788390440.445769:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:1.0:1788390440.445781:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11540:x1875263093814400:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1788390440.445864:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445881:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445901:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445931:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445935:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445940:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445944:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.445948:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.445953:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.446033:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.446037:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390440.446042:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.446049:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd3299c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.446132:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11540:x1875263093814400:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 353us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.446140:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1788390440.448313:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.449003:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093814656 00000100:00100000:0.0:1788390440.449018:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093814656 00000100:00100000:0.0:1788390440.449091:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390440.449105:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11540:x1875263093814656:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390440.449393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:11540:x1875263093814656:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 291us (1090us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788390440.449402:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788390440.468258:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.468427:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093814912 00000100:00100000:1.0:1788390440.468459:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093814912 00000100:00100000:1.0:1788390440.468530:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:1.0:1788390440.468543:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:11075:x1875263093814912:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390440.468578:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.468606:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.468744:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.468762:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.468772:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.468817:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 28 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.468834:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 28 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.468850:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103241088:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390440.468947:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390440.471468:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103241088:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390440.471475:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390440.471561:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815040 00000100:00100000:3.0:1788390440.471570:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815040 00010000:00010000:1.0:1788390440.471631:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471657:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 29 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.471698:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788390440.471708:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:2356:x1875263093815040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390440.471742:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390440.471748:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 29 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471758:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 29 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471779:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd3298e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed8d expref: 29 pid: 8163 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471791:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:3.0:1788390440.471794:0:11126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471802:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471807:0:11126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.471828:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390440.471844:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.471857:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390440.471879:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:3.0:1788390440.471892:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:2356:x1875263093815040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 186us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.471899:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00010000:00010000:1.0:1788390440.472114:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.472131:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.472139:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.472142:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390440.472145:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390440.472178:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:11075:x1875263093814912:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3639us (3937us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788390440.472186:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:2.0:1788390440.475810:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.475920:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815296 00000100:00100000:1.0:1788390440.475933:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815296 00000100:00100000:1.0:1788390440.476183:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:1.0:1788390440.476197:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:11075:x1875263093815296:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1788390440.476561:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.476584:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.476598:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390440.476685:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000004:00010000:1.0:1788390440.476713:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000407cd194 reply state 000000006eb4ac30 transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.476724:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788390440.476815:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967472 00000100:00100000:1.0:1788390440.477164:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11075:x1875263093815296:12345-192.168.202.1@tcp:36:bash.0 Request processed in 968us (1368us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788390440.477172:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000020:00080000:1.0:1788390440.478016:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788390440.481354:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390440.481385:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.481400:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.481433:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.481439:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390440.481445:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.481453:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.481468:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815424 00010000:00010000:3.0:1788390440.481474:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:3.0:1788390440.481477:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390440.481480:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815424 00010000:00010000:3.0:1788390440.481481:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.481487:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd329b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.481548:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1788390440.481560:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11075:x1875263093815424:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390440.481592:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.481613:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfed9b expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.481688:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed9b expref: 32 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.481701:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed9b expref: 32 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.481719:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.481721:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390440.481722:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390440.481849:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11075:x1875263093815424:12345-192.168.202.1@tcp:101:bash.0 Request processed in 291us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.481857:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1788390440.483695:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.483767:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815552 00000100:00100000:1.0:1788390440.483779:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815552 00000100:00100000:1.0:1788390440.483852:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1788390440.483864:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:11075:x1875263093815552:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390440.483896:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.483924:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeda2 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390440.483995:0:8777:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a98ac27, atime: 0x6a98ac26, ctime: 0x6a98ac27, blocks: 0xb 00010000:00010000:1.0:1788390440.484022:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=257s v=(0 0) 00010000:00010000:1.0:1788390440.484027:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390440.484037:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.484057:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.484073:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390440.484134:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:11075:x1875263093815552:12345-192.168.202.1@tcp:101:bash.0 Request processed in 272us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.484142:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788390440.487248:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.487394:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815680 00000100:00100000:0.0:1788390440.487408:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815680 00002000:00010000:0.0:1788390440.487464:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788390440.487470:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5dfb80 with x1875263093815680 ext(0->18446744073709551615) 00002000:00010000:0.0:1788390440.487486:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5dfb80. 00000100:00100000:0.0:1788390440.487527:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390440.487541:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093815680:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:0.0:1788390440.487903:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788390440.487908:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788390439 -> 1788390440 00002000:00010000:0.0:1788390440.487911:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788390438 -> 1788390438 00002000:00010000:0.0:1788390440.487913:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788390439 -> 1788390440 00002000:00010000:0.0:1788390440.487915:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788390440.488024:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093815680:12345-192.168.202.1@tcp:10:bash.0 Request processed in 485us (799us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788390440.488033:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00010000:0.0:1788390440.488038:0:6656:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788390440.488041:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5dfb80 with x1875263093815680 ext(0->18446744073709551615) 00002000:00010000:0.0:1788390440.488046:0:6656:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5dfb80. 00000100:00100000:0.0:1788390440.531015:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.531194:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093815808 00000100:00100000:2.0:1788390440.531209:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093815808 00000100:00100000:2.0:1788390440.531303:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1788390440.531318:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11554:x1875263093815808:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788390440.531430:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531451:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531466:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531495:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531504:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531511:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531836:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531848:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531855:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390440.531905:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531919:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531926:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531934:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531940:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390440.531945:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.531954:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532008:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390440.532012:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390440.532018:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532030:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd329cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532045:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532052:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532058:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532063:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390440.532067:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532073:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532081:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d68641ef00) 00010000:00010000:2.0:1788390440.532084:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390440.532087:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532093:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd329d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532109:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532115:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532128:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532133:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390440.532136:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532142:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532150:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:2.0:1788390440.532153:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390440.532156:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.532163:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd329db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.532271:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11554:x1875263093815808:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 955us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.532281:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:3.0:1788390440.562684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.562793:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093816064 00000100:00100000:1.0:1788390440.562808:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093816064 00000100:00100000:1.0:1788390440.562910:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:1.0:1788390440.562928:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+32:11557:x1875263093816064:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390440.563000:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.563027:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd329e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeda9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564759:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564784:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564796:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564810:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564814:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.564818:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565139:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd329f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565145:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd329f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565150:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd329f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390440.565168:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788390440.565264:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565270:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565275:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565278:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.565282:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565288:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565299:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.565301:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.565304:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565308:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd329e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565318:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565322:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565332:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565352:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.565355:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565362:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565375:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5a100) 00010000:00010000:1.0:1788390440.565378:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.565383:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565388:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd329f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565452:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd329e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda9 expref: 35 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565467:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd329f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda9 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.565476:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.565478:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390440.565481:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390440.565579:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11557:x1875263093816064:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2656us (2904us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788390440.565598:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1788390440.570257:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.571006:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093816192 00000100:00100000:2.0:1788390440.571022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093816192 00000100:00100000:2.0:1788390440.571101:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:2.0:1788390440.571114:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11557:x1875263093816192:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1788390440.571209:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.571232:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.571260:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.571306:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.571321:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 34 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.571348:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103241216:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390440.571561:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390440.573606:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103241216:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390440.573643:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.574094:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.574219:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093816448 00000100:00100000:2.0:1788390440.574228:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093816448 00000100:00100000:2.0:1788390440.574295:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1788390440.574305:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:5589:x1875263093816448:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788390440.574695:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:5589:x1875263093816448:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 386us (599us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788390440.574705:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1788390440.576053:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390440.576186:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093816576 00000100:00100000:3.0:1788390440.576197:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093816576 00010000:00010000:3.0:1788390440.576251:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 36 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.576285:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390440.576292:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:2357:x1875263093816576:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390440.576326:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390440.576342:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 36 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576359:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 36 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576387:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd329aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed94 expref: 36 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576402:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:3.0:1788390440.576406:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576415:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576421:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.576492:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390440.576534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:2357:x1875263093816576:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 243us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.576540:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00010000:00010000:2.0:1788390440.576906:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.576915:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.576956:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577297:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577304:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577309:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390440.577313:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577321:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577344:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:2.0:1788390440.577348:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390440.577352:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.577359:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.577415:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11557:x1875263093816192:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 6303us (7179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.577425:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1788390440.578699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.578805:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093816832 00000100:00100000:1.0:1788390440.578816:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093816832 00000100:00100000:1.0:1788390440.578889:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788390440.578900:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+34:11557:x1875263093816832:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390440.579434:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11557:x1875263093816832:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 535us (740us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788390440.579444:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1788390440.633243:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.633403:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093817088 00000100:00100000:0.0:1788390440.633417:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093817088 00000100:00100000:0.0:1788390440.633500:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1788390440.633513:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+35:11568:x1875263093817088:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1788390440.633546:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390440.633577:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd32a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedb0 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633747:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633765:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633779:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633799:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633807:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.633813:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636180:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd32a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636219:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd32a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636234:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd32a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390440.636252:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788390440.636386:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636394:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636401:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636407:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.636413:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636421:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636436:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390440.636439:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.636445:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636451:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636466:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636479:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636486:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636491:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.636494:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636501:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636509:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390440.636512:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.636514:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636520:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636580:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd32a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb0 expref: 38 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636595:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd32a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb0 expref: 37 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.636603:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:0.0:1788390440.636606:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390440.636614:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:0.0:1788390440.636729:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11568:x1875263093817088:12345-192.168.202.1@tcp:101:cat.0 Request processed in 3216us (3495us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788390440.636739:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1788390440.641523:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.641683:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093817344 00000100:00100000:2.0:1788390440.641696:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093817344 00000100:00100000:2.0:1788390440.641770:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788390440.641802:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11568:x1875263093817344:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:2.0:1788390440.642215:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11568:x1875263093817344:12345-192.168.202.1@tcp:35:cat.0 Request processed in 417us (702us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788390440.642225:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1788390440.652494:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.652841:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093817600 00000100:00100000:1.0:1788390440.652854:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093817600 00000100:00100000:1.0:1788390440.652928:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:1.0:1788390440.652944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11569:x1875263093817600:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:1.0:1788390440.653272:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788390440.653309:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd32a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb0 expref: 38 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653331:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd329f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda9 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653356:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd329bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed9b expref: 36 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653366:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.653382:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390440.653404:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653434:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653443:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653454:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653459:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.653463:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654112:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654120:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654125:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390440.654643:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:1.0:1788390440.654735:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654745:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654754:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654770:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654776:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654783:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654809:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390440.654839:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654844:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654848:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654852:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.654856:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654860:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654868:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:1.0:1788390440.654870:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788390440.654873:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654884:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654899:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654903:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654906:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654909:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.654911:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654914:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654918:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.654920:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.654921:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.654924:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390440.654930:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a65e1a32 reply state 000000009e7915ab transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.654943:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390440.655072:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+37:11569:x1875263093817600:12345-192.168.202.1@tcp:36:rm.0 Request processed in 2133us (2588us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788390440.655081:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00010000:00010000:2.0:1788390440.655328:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390440.655353:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.655363:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390440.655368:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.655377:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.655389:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95d683b5ac00) 00010000:00010000:2.0:1788390440.655393:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788390440.655397:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.655403:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32a44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.655428:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390440.655431:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390440.655433:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390440.659807:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663127:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663147:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663151:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.663156:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663163:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663178:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5a100) 00010000:00010000:0.0:1788390440.663181:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.663184:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.663188:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32a36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.680681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.680768:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093817856 00000100:00100000:1.0:1788390440.680776:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093817856 00000100:00100000:1.0:1788390440.680825:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:1.0:1788390440.680833:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+36:11575:x1875263093817856:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390440.680854:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.680871:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedb7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683067:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683090:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683103:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683120:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683128:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.683133:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390440.683844:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788390440.684036:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684051:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684060:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684098:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684105:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684113:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684119:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.684123:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684130:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684140:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.684144:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.684148:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684154:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32a52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390440.684166:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a2e1bad reply state 0000000072c12103 transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.684179:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788390440.684230:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd32a4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684247:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.684255:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d683b5a200) 00010000:00010000:1.0:1788390440.684257:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390440.684259:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390440.684347:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11575:x1875263093817856:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3512us (3675us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788390440.684355:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00010000:00010000:1.0:1788390440.685509:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685521:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685527:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685532:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.685536:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685542:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685570:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.685573:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.685576:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.685582:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.686899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.687102:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093817984 00000100:00100000:2.0:1788390440.687112:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093817984 00000100:00100000:2.0:1788390440.687168:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788390440.687175:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2359:x1875263093817984:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390440.687198:0:6653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390440.687212:0:6653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedbe expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390440.687232:0:6653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390440.687259:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=257s v=(0 0) 00010000:00010000:2.0:1788390440.687263:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390440.687272:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 6 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.687289:0:6653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 6 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.687301:0:6653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:2.0:1788390440.687360:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2359:x1875263093817984:12345-192.168.202.1@tcp:101:bash.0 Request processed in 184us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.687368:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00080000:0.0:1788390440.688039:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390440.693533:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.693837:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093818112 00000100:00100000:1.0:1788390440.693848:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093818112 00000100:00100000:1.0:1788390440.693905:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788390440.693916:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:11575:x1875263093818112:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390440.693934:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.693953:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedc5 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.694009:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.694018:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390440.694023:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390440.694028:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.694062:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.694089:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.694104:0:6650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103241344:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390440.694189:0:6650:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390440.696929:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390440.697037:0:6650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6650:1875263103241344:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390440.697068:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390440.697087:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:3.0:1788390440.697135:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:11575:x1875263093818112:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3219us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.697144:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1788390440.698173:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093818240 00000100:00100000:2.0:1788390440.698182:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093818240 00010000:00010000:2.0:1788390440.698227:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.698271:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1788390440.698281:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093818240:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390440.698294:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390440.698315:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.698353:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.698380:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32a6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedbe expref: 7 pid: 6653 timeout: 357 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.698394:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390440.698398:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390440.698407:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.698417:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.698452:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.698465:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5793:1875263103241472:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390440.698527:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390440.701047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.701070:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5793:1875263103241472:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390440.701112:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093818496 00000100:00100000:0.0:1788390440.701131:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093818496 00000100:00100000:0.0:1788390440.701181:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1788390440.701192:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+38:11575:x1875263093818496:12345-192.168.202.1@tcp:35:bash.0 00010000:00010000:2.0:1788390440.701569:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390440.701605:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11575:x1875263093818496:12345-192.168.202.1@tcp:35:bash.0 Request processed in 415us (567us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788390440.701613:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390440.701663:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2357:x1875263093818240:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3384us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.701672:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1788390440.793801:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.793858:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093818624 00000100:00100000:2.0:1788390440.793868:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093818624 00000100:00100000:2.0:1788390440.793919:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:2.0:1788390440.793926:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+39:11591:x1875263093818624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390440.793948:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390440.793985:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedcc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794039:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794049:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794057:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390440.794085:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788390440.794087:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390440.794100:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794116:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedcc expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794130:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedcc expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.794135:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390440.794137:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390440.794150:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:2.0:1788390440.794206:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11591:x1875263093818624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 281us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.794211:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:3.0:1788390440.797858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.797909:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093818880 00000100:00100000:0.0:1788390440.797919:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093818880 00000100:00100000:0.0:1788390440.798029:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:0.0:1788390440.798038:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+40:11591:x1875263093818880:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390440.798055:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390440.798070:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedd3 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.798149:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.798160:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.798166:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.798202:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.798212:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 41 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.798237:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f417800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103241600:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390440.798316:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.801298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.801477:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819008 00000100:00100000:1.0:1788390440.801487:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819008 00010000:00010000:1.0:1788390440.801531:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 42 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.801571:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788390440.801581:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:2356:x1875263093819008:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390440.801597:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390440.801604:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 42 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.801617:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 42 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.801641:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d683b5a200) 00010000:00010000:1.0:1788390440.801647:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.801675:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.801682:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.801703:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390440.801772:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:2356:x1875263093819008:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.801780:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:0.0:1788390440.803463:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd32a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedb7 expref: 41 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.803488:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f417800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103241600:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390440.803512:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.803523:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.803529:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390440.803551:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788390440.803712:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd32a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedd3 expref: 42 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.803728:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedd3 expref: 41 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.803738:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d683b5a200) 00010000:00010000:0.0:1788390440.803742:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390440.803745:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:0.0:1788390440.803807:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11591:x1875263093818880:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 5769us (5958us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788390440.803832:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:3.0:1788390440.805905:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.805981:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819264 00000100:00100000:2.0:1788390440.805989:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819264 00000100:00100000:2.0:1788390440.806036:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1788390440.806043:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+41:11591:x1875263093819264:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390440.806063:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390440.806065:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390440.806084:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd32a91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedd3 expref: 41 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806097:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d683b5a200) 00010000:00010000:2.0:1788390440.806107:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390440.806117:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedda expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806196:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806206:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806212:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390440.806220:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788390440.806360:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedda expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806380:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedda expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.806385:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e200) 00010000:00010000:2.0:1788390440.806388:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390440.806389:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93800, rc 0) 00000100:00100000:2.0:1788390440.806437:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11591:x1875263093819264:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 395us (540us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788390440.806442:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:3.0:1788390440.810083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.810151:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819392 00000100:00100000:1.0:1788390440.810160:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819392 00000100:00100000:1.0:1788390440.810215:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:1.0:1788390440.810226:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+42:11591:x1875263093819392:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390440.810254:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.810271:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfede1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.810344:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.810363:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.810380:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e200) 00010000:00010000:1.0:1788390440.810382:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390440.810385:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390440.810443:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:11591:x1875263093819392:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 220us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.810449:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:3.0:1788390440.815784:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.816645:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819520 00000100:00100000:2.0:1788390440.816656:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819520 00000100:00100000:2.0:1788390440.816757:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788390440.816769:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+6:2356:x1875263093819520:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1788390440.816816:0:6653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.816835:0:6653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.816844:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390440.816849:0:6653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390440.816853:0:6653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.816888:0:6653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.816917:0:6653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 6 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.816934:0:6653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103241728:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390440.817041:0:6653:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.823647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.823734:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819648 00000100:00100000:0.0:1788390440.823746:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819648 00002000:00100000:0.0:1788390440.824059:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff95d6bbfee300 x1875263093819648/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:56/0 lens 504/0 e 0 to 0 dl 1788390451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390440.824067:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbfee300 with x1875263093819648 ext(0->8) 00010000:00010000:0.0:1788390440.824074:0:6657:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 7 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.824087:0:6657:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 7 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390440.824092:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbfee300 00000100:00100000:0.0:1788390440.824123:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390440.824131:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093819648:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:0.0:1788390440.824593:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093819648:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 460us (956us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788390440.824602:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:0.0:1788390440.824610:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff95d6bbfee300 x1875263093819648/t4294967308(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:56/0 lens 504/448 e 0 to 0 dl 1788390451 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390440.824619:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbfee300 with x1875263093819648 ext(0->8) 00010000:00010000:0.0:1788390440.824624:0:6657:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.824647:0:6657:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390440.824654:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbfee300 00000100:00100000:2.0:1788390440.825314:0:6653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6653:1875263103241728:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390440.825347:0:6653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390440.826645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.826712:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093819776 00000100:00100000:2.0:1788390440.826725:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093819776 00010000:00010000:2.0:1788390440.826763:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.827012:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1788390440.827022:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2358:x1875263093819776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390440.827040:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788390440.827058:0:11126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788390440.827061:0:11126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788390440 00002000:00010000:2.0:1788390440.827063:0:11126:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788390441 00002000:00010000:2.0:1788390440.827064:0:11126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788390440 00010000:00010000:2.0:1788390440.827069:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.827095:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.827117:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd32a75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedc5 expref: 9 pid: 6650 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.827131:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390440.827134:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390440.827140:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.827146:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.827171:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390440.827212:0:6653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827223:0:6653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390440.827226:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2358:x1875263093819776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 205us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.827234:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00010000:00010000:0.0:1788390440.827249:0:6653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827257:0:6653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827266:0:6653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827273:0:6653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390440.827278:0:6653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827292:0:6653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827317:0:6653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.827323:0:6653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd32abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.827383:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093819520:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 10616us (11609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.827391:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788390440.829916:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.830048:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820032 00000100:00100000:1.0:1788390440.830061:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820032 00000100:00100000:1.0:1788390440.830119:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1788390440.830129:0:5809:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788390440.830132:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6ae2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+43:11591:x1875263093820032:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390440.830142:0:5809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:1.0:1788390440.830205:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedda expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390440.830519:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967484 00000001:00080000:1.0:1788390440.830575:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000001:00080000:1.0:1788390440.837812:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00010000:00010000:1.0:1788390440.837914:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.837936:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.837945:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.838007:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.838023:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 47 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.838038:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5810:1875263103241856:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390440.838147:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390440.841883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.841911:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5810:1875263103241856:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390440.841940:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.842034:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820160 00000100:00100000:0.0:1788390440.842043:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820160 00010000:00010000:0.0:1788390440.842080:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 48 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.842164:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788390440.842186:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+48:2356:x1875263093820160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390440.842201:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390440.842208:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 48 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842220:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 48 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842240:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede1 expref: 48 pid: 5807 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842266:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e200) 00010000:00010000:0.0:1788390440.842271:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842281:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842288:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.842312:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390440.842373:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+47:2356:x1875263093820160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.842380:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00010000:00010000:1.0:1788390440.842432:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.842440:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390440.842558:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788390440.842745:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000100:00100000:1.0:1788390440.842844:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5810:1875263103241984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788390440.842888:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.842917:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390440.842938:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103241984 00000100:00100000:2.0:1788390440.842944:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103241984 00000100:00100000:2.0:1788390440.843003:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390440.843012:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1875263103241984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788390440.843078:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1875263103241984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.843085:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390440.843472:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5810:1875263103241984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788390440.843907:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000100:00100000:1.0:1788390440.843984:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5810:1875263103242112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788390440.844030:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390440.844055:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390440.844071:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103242112 00000100:00100000:2.0:1788390440.844077:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103242112 00000100:00100000:2.0:1788390440.844138:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390440.844145:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1875263103242112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788390440.844320:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5810:x1875263103242112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (289us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788390440.844327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390440.844383:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd12d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5810:1875263103242112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788390440.844426:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788390440.844464:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844473:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844480:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844486:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.844491:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844509:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844525:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e200) 00010000:00010000:0.0:1788390440.844529:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788390440.844534:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.844539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ac2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390440.844701:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788390440.844802:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788390440.844814:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 257951852240ns, next at 258951849857ns, rc = 0 00000001:00080000:0.0:1788390440.844820:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1788390440.844853:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e200) 00010000:00010000:0.0:1788390440.844856:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788390440.844862:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32aa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedda expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.844957:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6ae2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+50:11591:x1875263093820032:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 14828us (15052us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1788390440.844987:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000020:00080000:0.0:1788390440.844992:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788390440.847000:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390440.847054:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820288 00000100:00100000:2.0:1788390440.847062:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820288 00000100:00100000:2.0:1788390440.847130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:2.0:1788390440.847138:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+50:11591:x1875263093820288:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390440.847159:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390440.847181:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32ac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfede8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.847243:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede8 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.847254:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede8 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390440.847266:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390440.847268:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390440.847271:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:2.0:1788390440.847328:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:11591:x1875263093820288:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 190us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.847344:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1788390440.851641:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.851696:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820544 00000100:00100000:0.0:1788390440.851708:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820544 00000100:00100000:0.0:1788390440.851773:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1788390440.851783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+51:11591:x1875263093820544:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390440.852080:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:11591:x1875263093820544:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 298us (448us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1788390440.852090:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788390440.910482:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390440.910509:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390440.910581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390440.910749:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103242240 00000100:00100000:0.0:1788390440.910766:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103242240 00000100:00100000:0.0:1788390440.910861:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390440.910874:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103242240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390440.910907:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390440.911046:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103242240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.911054:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788390440.912948:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390440.915205:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.916147:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820672 00000100:00100000:0.0:1788390440.916165:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820672 00000100:00100000:0.0:1788390440.916249:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:0.0:1788390440.916262:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:11601:x1875263093820672:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788390440.916386:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916409:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916424:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916442:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916449:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916472:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916606:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916614:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916622:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390440.916676:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916691:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916697:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916705:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916711:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.916716:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916723:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916738:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390440.916749:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.916755:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916762:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd32ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916777:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916783:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916789:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916795:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.916797:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916804:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916811:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d684d23d00) 00010000:00010000:0.0:1788390440.916814:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.916817:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916823:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916851:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916864:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916870:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916875:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390440.916878:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916884:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916892:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390440.916894:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390440.916897:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390440.916903:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd32ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390440.917442:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:11601:x1875263093820672:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1178us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.917452:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1788390440.960544:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.960644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093820928 00000100:00100000:1.0:1788390440.960659:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093820928 00000100:00100000:1.0:1788390440.960733:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1788390440.960747:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+52:11604:x1875263093820928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390440.960768:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390440.960790:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedef expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960876:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960892:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960904:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960920:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960927:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.960934:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961078:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961087:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961095:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390440.961175:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788390440.961406:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961415:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961428:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961434:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.961439:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961446:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961460:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390440.961463:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.961468:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961475:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961489:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961496:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961502:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961507:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.961510:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961526:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961534:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5af00) 00010000:00010000:1.0:1788390440.961537:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390440.961540:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961546:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961589:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961602:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.961610:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390440.961612:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390440.961615:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63c00, rc 0) 00000100:00100000:1.0:1788390440.961679:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:11604:x1875263093820928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 936us (1150us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788390440.961687:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788390440.965140:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390440.965230:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093821056 00000100:00100000:1.0:1788390440.965248:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093821056 00000100:00100000:1.0:1788390440.965296:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:1.0:1788390440.965310:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:11604:x1875263093821056:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1788390440.965413:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965429:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965441:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965466:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965474:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965480:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965484:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390440.965487:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965493:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965501:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390440.965503:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390440.965505:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390440.965509:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390440.965578:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:11604:x1875263093821056:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 269us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390440.965583:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:3.0:1788390440.967141:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390440.967267:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093821312 00000100:00100000:0.0:1788390440.967274:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093821312 00000100:00100000:0.0:1788390440.967475:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1788390440.967487:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+54:11604:x1875263093821312:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390440.967662:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:11604:x1875263093821312:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 179us (526us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788390440.967672:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788390441.023933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.024060:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093821568 00000100:00100000:1.0:1788390441.024070:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093821568 00000100:00100000:1.0:1788390441.024131:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1788390441.024142:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:11614:x1875263093821568:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390441.024164:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.024166:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390441.024190:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd32a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedcc expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024211:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390441.024216:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390441.024230:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedf6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024338:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024352:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024365:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024507:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.024533:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 55 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.024548:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103242368:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.024734:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390441.028530:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.028680:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093821696 00000100:00100000:2.0:1788390441.028690:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093821696 00010000:00010000:2.0:1788390441.028740:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 56 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.028774:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390441.028783:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:2356:x1875263093821696:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390441.028796:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390441.028802:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 56 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.028813:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 56 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.028832:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390441.028837:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.028845:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.028852:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.028868:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390441.028924:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+56:2356:x1875263093821696:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 142us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.028946:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:1.0:1788390441.029605:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedef expref: 55 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.029624:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5805:1875263103242368:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.029646:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.029655:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.029661:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390441.029680:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788390441.029895:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.029906:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.029912:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.029920:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390441.029922:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390441.030164:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:11614:x1875263093821568:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6022us (6240us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788390441.030172:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:3.0:1788390441.032625:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390441.032787:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093821952 00000100:00100000:0.0:1788390441.032797:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093821952 00000100:00100000:0.0:1788390441.032847:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:0.0:1788390441.032854:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+55:11614:x1875263093821952:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1788390441.033097:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.033110:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.033118:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390441.033155:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000004:00010000:0.0:1788390441.033172:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7144357 reply state 00000000368de353 transno 4294967498 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.033178:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390441.033251:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:11614:x1875263093821952:12345-192.168.202.1@tcp:36:bash.0 Request processed in 395us (635us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788390441.033258:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000020:00080000:0.0:1788390441.033263:0:8163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788390441.035468:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035480:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035485:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035501:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390441.035504:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035509:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035522:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390441.035524:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390441.035527:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.035531:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.036698:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.036913:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822080 00000100:00100000:2.0:1788390441.036923:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822080 00000100:00100000:2.0:1788390441.036996:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:2.0:1788390441.037007:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:11614:x1875263093822080:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390441.037037:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390441.037059:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfedfd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.037136:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.037147:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.037154:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.037179:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.037189:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 58 pid: 5805 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.037203:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103242496:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390441.037515:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390441.039483:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.039879:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103242496:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390441.039916:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.040075:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822208 00000100:00100000:1.0:1788390441.040082:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822208 00010000:00010000:1.0:1788390441.040367:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 59 pid: 5805 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.040481:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788390441.040493:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:2356:x1875263093822208:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390441.040506:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390441.040513:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 59 pid: 5805 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040525:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 59 pid: 5805 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040546:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedf6 expref: 59 pid: 5805 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040560:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.040565:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040574:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040594:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.040622:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390441.040674:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:2356:x1875263093822208:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 183us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.040682:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00010000:00010000:2.0:1788390441.040737:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.040745:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390441.040787:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788390441.040792:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390441.040811:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.040840:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd32b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.040855:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.040862:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390441.040865:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390441.040867:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93600, rc 0) 00000100:00100000:2.0:1788390441.040891:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:11614:x1875263093822080:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3887us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.040897:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:0.0:1788390441.043884:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.044005:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822464 00000100:00100000:3.0:1788390441.044014:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822464 00000100:00100000:3.0:1788390441.044066:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788390441.044077:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+57:11614:x1875263093822464:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:3.0:1788390441.044626:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:11614:x1875263093822464:12345-192.168.202.1@tcp:35:bash.0 Request processed in 551us (751us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788390441.044635:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788390441.081047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390441.081126:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822592 00000100:00100000:0.0:1788390441.081135:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822592 00000100:00100000:0.0:1788390441.081221:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1788390441.081230:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+58:11620:x1875263093822592:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390441.081257:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390441.081273:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee04 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081343:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081358:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081387:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390441.081423:0:8163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788390441.081426:0:8163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390441.081448:0:8163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081473:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd32b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee04 expref: 60 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081489:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee04 expref: 59 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.081495:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390441.081497:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390441.081500:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788390441.081550:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093822592:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 323us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390441.081555:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:2.0:1788390441.083601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.083657:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822720 00000100:00100000:1.0:1788390441.083667:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822720 00000100:00100000:1.0:1788390441.083728:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:1.0:1788390441.083740:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093822720:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390441.083759:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.084202:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee0b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084264:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084279:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084290:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084304:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084312:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084348:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084425:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084431:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084435:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390441.084461:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788390441.084464:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390441.084476:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084484:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084489:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084493:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084497:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084500:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.084503:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084513:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084521:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390441.084523:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390441.084526:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084530:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084539:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084543:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084546:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084549:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.084551:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084554:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084557:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.084558:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390441.084560:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084570:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084597:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee0b expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084605:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee0b expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.084610:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.084611:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390441.084613:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390441.084667:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11620:x1875263093822720:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 929us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.084674:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:2.0:1788390441.087487:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.087520:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.087566:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823104 00000100:00100000:1.0:1788390441.087572:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093822848 00000100:00100000:3.0:1788390441.087576:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823104 00000100:00100000:1.0:1788390441.087576:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093822848 00000100:00100000:3.0:1788390441.087632:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:3.0:1788390441.087643:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11620:x1875263093823104:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390441.087662:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390441.087681:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee12 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.087708:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390441.087716:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+62:2359:x1875263093822848:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390441.087729:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390441.087749:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee0b expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.087765:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.087769:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390441.087824:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:2359:x1875263093822848:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.087845:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:3.0:1788390441.087894:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.087909:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.087918:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.087957:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.087991:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 60 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.088005:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbfed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103242624:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390441.088064:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390441.090153:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbfed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103242624:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390441.090184:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.091737:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.091806:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823232 00000100:00100000:1.0:1788390441.091814:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823232 00010000:00010000:1.0:1788390441.091850:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 61 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.091883:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788390441.091890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:2356:x1875263093823232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390441.091900:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390441.091906:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 61 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.091915:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 61 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.091931:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfedfd expref: 61 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.091943:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.091947:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.091954:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.091984:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.092018:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390441.092062:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:2356:x1875263093823232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 172us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.092067:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00010000:00010000:0.0:1788390441.092113:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.092119:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390441.092133:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788390441.092273:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.092291:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.092296:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390441.092306:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390441.092308:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:0.0:1788390441.092328:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11620:x1875263093823104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4689us (4807us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788390441.092353:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:2.0:1788390441.095555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.095647:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823488 00000100:00100000:3.0:1788390441.095655:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823488 00000100:00100000:3.0:1788390441.095734:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390441.095745:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11620:x1875263093823488:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788390441.095761:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.095783:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfede8 expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.095801:0:11126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390441.095805:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390441.095860:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093823488:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.095867:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390441.097669:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.097744:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823616 00000100:00100000:1.0:1788390441.097752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823616 00000100:00100000:1.0:1788390441.097805:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1788390441.097815:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093823616:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1788390441.097910:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.097926:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.097937:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390441.098148:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788390441.098211:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093823616:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 398us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.098216:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:0.0:1788390441.101571:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.101653:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823744 00000100:00100000:1.0:1788390441.101664:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823744 00000100:00100000:1.0:1788390441.101721:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788390441.101731:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+59:11620:x1875263093823744:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390441.101753:0:8163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.101775:0:8163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee19 expref: -99 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101858:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101869:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 60 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101889:0:8163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101902:0:8163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 60 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101915:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.101919:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390441.101922:0:8163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 60 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.101929:0:8163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390441.102148:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11620:x1875263093823744:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 417us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.102155:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000040:00080000:3.0:1788390441.102371:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390441.102376:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390441.102419:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788390441.102425:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390441.102522:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbfed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103242752:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390441.102571:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.119217:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.119370:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093823872 00000100:00100000:1.0:1788390441.119381:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093823872 00000100:00100000:1.0:1788390441.119439:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:1.0:1788390441.119450:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093823872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390441.119482:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390441.119601:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093823872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 152us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.119610:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:3.0:1788390441.120644:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbfed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103242752:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390441.124535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.124652:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093824000 00000100:00100000:3.0:1788390441.124662:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093824000 00000100:00100000:3.0:1788390441.124724:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:3.0:1788390441.124734:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11621:x1875263093824000:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788390441.124804:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124821:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124832:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124847:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124853:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124860:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124882:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124903:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.124909:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390441.124946:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788390441.124950:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390441.124995:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125007:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125014:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125020:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125025:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390441.125029:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125035:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125046:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788390441.125049:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390441.125054:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125071:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32b86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125092:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125097:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125103:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125108:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390441.125111:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125117:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125125:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff95d6a704c700) 00010000:00010000:3.0:1788390441.125127:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390441.125132:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125137:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32b8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125151:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125156:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125167:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125172:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390441.125174:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125179:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125187:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390441.125189:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390441.125192:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.125197:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.125279:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11621:x1875263093824000:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 545us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.125287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:0.0:1788390441.130566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.130678:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093824256 00000100:00100000:1.0:1788390441.130688:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093824256 00000100:00100000:1.0:1788390441.130784:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:1.0:1788390441.130795:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+60:11621:x1875263093824256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.130814:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.130832:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee20 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.130921:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.130936:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.130948:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390441.130994:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788390441.131084:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131091:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131098:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131104:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.131119:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131128:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131140:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390441.131144:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390441.131148:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131155:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131203:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b9b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee20 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131212:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788390441.131214:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390441.131218:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32b9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee20 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.131228:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63c00, rc 0) 00000100:00100000:1.0:1788390441.131502:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093824256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 707us (944us total) trans 4294967501 rc 301/301 00000100:00100000:1.0:1788390441.131510:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1788390441.134811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.134894:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093824384 00000100:00100000:3.0:1788390441.134904:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093824384 00000100:00100000:3.0:1788390441.134991:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:3.0:1788390441.135003:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093824384:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390441.135035:0:5807:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390441.135127:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093824384:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.135150:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:0.0:1788390441.138010:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.138199:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093824640 00000100:00100000:2.0:1788390441.138210:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093824640 00000100:00100000:2.0:1788390441.138259:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788390441.138269:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093824640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390441.138289:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390441.138292:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390441.139001:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee04 expref: 61 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139023:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390441.139028:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390441.139045:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32bb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee27 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390441.139488:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788390441.139690:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139703:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139715:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139767:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd32bb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee27 expref: 63 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139801:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee27 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.139809:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d68641e200) 00010000:00010000:2.0:1788390441.139811:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390441.139814:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93600, rc 0) 00000100:00100000:2.0:1788390441.139876:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+62:11621:x1875263093824640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1607us (1874us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788390441.139885:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:0.0:1788390441.142948:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.143542:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093824896 00000100:00100000:3.0:1788390441.143554:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093824896 00000100:00100000:3.0:1788390441.143656:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:3.0:1788390441.143668:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+62:11621:x1875263093824896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390441.143737:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.143764:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd32bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee27 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143783:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d68641e200) 00010000:00010000:3.0:1788390441.143791:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390441.143813:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143826:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143836:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143849:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143856:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143863:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143943:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143950:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143955:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.143996:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390441.144000:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144008:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144017:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788390441.144020:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390441.144024:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144029:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32bc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144040:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144045:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144051:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144061:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390441.144064:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144069:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144076:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6dbc5aff (ffff95d6a704c700) 00010000:00010000:3.0:1788390441.144078:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390441.144080:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.144085:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32bcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6dbc5aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.144165:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093824896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 498us (1226us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390441.144172:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1788390441.146646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.146722:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093825024 00000100:00100000:1.0:1788390441.146732:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093825024 00000100:00100000:1.0:1788390441.146787:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:1.0:1788390441.146798:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+61:11621:x1875263093825024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.146831:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.146853:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32bd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee2e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.146886:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.146898:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.146909:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.147037:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 63 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.147054:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.147062:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.147065:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390441.147069:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390441.147117:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+62:11621:x1875263093825024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 321us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.147124:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:0.0:1788390441.152777:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.153132:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093825280 00000100:00100000:1.0:1788390441.153144:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093825280 00000100:00100000:1.0:1788390441.153283:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:1.0:1788390441.153295:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+62:11621:x1875263093825280:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.153406:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.153423:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.153434:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390441.153682:0:8163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788390441.153694:0:8163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 258260732492ns, next at 259260729721ns, rc = 0 00000004:00010000:1.0:1788390441.153782:0:8163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b5a6e6 reply state 00000000ab2e0f8a transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.153791:0:8163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390441.153945:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+64:11621:x1875263093825280:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 650us (1176us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788390441.153954:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00010000:00010000:1.0:1788390441.156766:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156782:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156790:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156796:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.156800:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156825:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156841:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.156844:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390441.156848:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.156854:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32be1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.159549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.159725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093825408 00000100:00100000:1.0:1788390441.159735:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093825408 00000100:00100000:1.0:1788390441.159800:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:1.0:1788390441.159812:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+63:11621:x1875263093825408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.159838:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.159858:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee35 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.159917:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 64 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.159931:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 64 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.159949:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.159952:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390441.159956:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390441.160046:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+64:11621:x1875263093825408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 236us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.160054:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:0.0:1788390441.163063:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.163149:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093825536 00000100:00100000:3.0:1788390441.163160:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093825536 00000100:00100000:3.0:1788390441.163248:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1788390441.163261:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093825536:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788390441.163563:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2357:x1875263093825536:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 305us (508us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788390441.163571:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00080000:0.0:1788390441.164544:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390441.167808:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.167911:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093825792 00000100:00100000:1.0:1788390441.167922:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093825792 00000100:00100000:1.0:1788390441.168008:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1788390441.168019:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+64:11621:x1875263093825792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390441.168495:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+65:11621:x1875263093825792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 476us (696us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788390441.168504:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788390441.173036:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.173109:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826048 00000100:00100000:3.0:1788390441.173118:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826048 00000100:00100000:3.0:1788390441.173177:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:3.0:1788390441.173191:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+65:11621:x1875263093826048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390441.173324:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+65:11621:x1875263093826048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.173339:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:2.0:1788390441.175475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.175643:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826176 00000100:00100000:1.0:1788390441.175650:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826176 00000100:00100000:1.0:1788390441.175692:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:1.0:1788390441.175702:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+65:11621:x1875263093826176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.175729:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.175750:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee3c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175824:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175835:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175844:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390441.175872:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390441.175890:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175910:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee3c expref: 67 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175921:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee3c expref: 66 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.175927:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.175929:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390441.175932:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390441.176008:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+66:11621:x1875263093826176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 308us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.176014:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1788390441.178038:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.178083:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826304 00000100:00100000:3.0:1788390441.178091:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826304 00000100:00100000:2.0:1788390441.178179:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788390441.178197:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+10:2356:x1875263093826304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390441.178214:0:6652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390441.178234:0:6652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee43 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390441.178260:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac29, blocks: 0x1 00010000:00010000:2.0:1788390441.178277:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=258s v=(0 0) 00010000:00010000:2.0:1788390441.178282:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390441.178290:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 11 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.178308:0:6652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 11 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.178348:0:6652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:2.0:1788390441.178391:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:2356:x1875263093826304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 197us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.178398:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788390441.179944:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.179999:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826560 00000100:00100000:3.0:1788390441.180008:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826560 00000100:00100000:3.0:1788390441.180055:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:3.0:1788390441.180064:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+66:11621:x1875263093826560:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390441.180151:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+66:11621:x1875263093826560:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.180159:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:3.0:1788390441.181850:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.181934:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826688 00000100:00100000:1.0:1788390441.181941:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826688 00000100:00100000:1.0:1788390441.182005:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788390441.182015:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:11621:x1875263093826688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.182030:0:8777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390441.182046:0:8777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee4a expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.182071:0:8777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 12 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.182077:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390441.182081:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390441.182093:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.182118:0:8777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 12 pid: 6652 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.182127:0:8777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 12 pid: 6652 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.182137:0:8777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103242880:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.182199:0:8777:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.184165:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.184262:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826816 00000100:00100000:2.0:1788390441.184270:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826816 00010000:00010000:2.0:1788390441.184306:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 13 pid: 6652 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.184356:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390441.184365:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2356:x1875263093826816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390441.184377:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390441.184399:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 13 pid: 6652 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.184412:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 13 pid: 6652 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.184433:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390441.184437:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390441.184445:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 13 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.184474:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 13 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.184522:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 13 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.184535:0:5794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1875263103243008:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390441.184612:0:5794:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31650c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390441.185092:0:8777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee43 expref: 13 pid: 6652 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.185107:0:8777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103242880:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.185132:0:8777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.185142:0:8777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390441.185182:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+12:11621:x1875263093826688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3168us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.185190:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390441.186610:0:5794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5794:1875263103243008:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788390441.186625:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390441.186695:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:2356:x1875263093826816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2331us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.186718:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390441.188327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.188405:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093826944 00000100:00100000:1.0:1788390441.188412:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093826944 00002000:00100000:1.0:1788390441.188451:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff95d6bc03df80 x1875263093826944/t0(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:57/0 lens 504/0 e 0 to 0 dl 1788390452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390441.188473:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc03df80 with x1875263093826944 ext(0->12) 00002000:00010000:1.0:1788390441.188477:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc03df80 00000100:00100000:1.0:1788390441.188503:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390441.188509:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+11:2356:x1875263093826944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788390441.188921:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2356:x1875263093826944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 409us (597us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788390441.188929:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:1.0:1788390441.188935:0:6658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff95d6bc03df80 x1875263093826944/t4294967320(0) o4->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:57/0 lens 504/448 e 0 to 0 dl 1788390452 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390441.188940:0:6658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc03df80 with x1875263093826944 ext(0->12) 00002000:00010000:1.0:1788390441.188943:0:6658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc03df80 00000100:00100000:0.0:1788390441.190424:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.190475:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827072 00000100:00100000:2.0:1788390441.190482:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827072 00000100:00100000:2.0:1788390441.190520:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:2.0:1788390441.190526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+66:11621:x1875263093827072:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788390441.217286:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:3.0:1788390441.217316:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788390441.217368:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:3.0:1788390441.217376:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788390441.217407:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6830466c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788390441.217412:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6bc7abb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d683046840 00000020:00080000:3.0:1788390441.217416:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6bc7ab100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d69ffde000 00000100:00100000:2.0:1788390441.217472:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+45:11621:x1875263093827072:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 26940us (27046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.217484:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1788390441.217517:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103243136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788390441.217590:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390441.217616:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390441.217628:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103243392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788390441.217638:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390441.217648:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103243264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788390441.217663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390441.217687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390441.217730:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103243136 00000100:00100000:0.0:1788390441.217738:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103243136 00000100:00100000:0.0:1788390441.217783:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103243392 00000100:00100000:0.0:1788390441.217786:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103243392 00000100:00100000:0.0:1788390441.217820:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103243264 00000100:00100000:0.0:1788390441.217824:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103243264 00000100:00080000:2.0:1788390441.217840:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390441.217847:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000020:00080000:3.0:1788390441.217852:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d68451c840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788390441.217858:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f458400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68451c780 00000100:00100000:0.0:1788390441.217859:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103243136:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788390441.217863:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f458000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d69ef42400 00002000:00080000:0.0:1788390441.217886:0:6652:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000020:00080000:3.0:1788390441.217892:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00002000:00010000:0.0:1788390441.217922:0:6652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a98ac28, atime: 0x6a98ac29, ctime: 0x6a98ac28, blocks: 0x1 00010000:00010000:0.0:1788390441.217931:0:6652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.217947:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1788390441.217952:0:6652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390441.217990:0:6652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.218007:0:6652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.218018:0:6652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.218027:0:6652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.218055:0:6652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390441.218080:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390441.218088:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.218102:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390441.218106:0:11621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.218115:0:11621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.218133:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.218142:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366a2180/0x9aafc5f04cd32c0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.218161:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390441.218164:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390441.218165:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390441.218252:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390441.218263:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103243392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788390441.218418:0:8777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788390441.218422:0:8777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788390441 00002000:00010000:1.0:1788390441.218425:0:8777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788390441.218428:0:8777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788390441 -> 1788390441 00002000:00010000:1.0:1788390441.218442:0:8777:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788390441.218501:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103243392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (831us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788390441.218519:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390441.218537:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390441.218545:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103243264:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788390441.218558:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3288:x1875263103243136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 699us (967us total) trans 4294967310 rc 0/0 00002000:00080000:1.0:1788390441.218567:0:8777:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:0.0:1788390441.218567:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788390441.218585:0:8777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.218601:0:8777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.218610:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788390441.218613:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00000004:00080000:0.0:1788390441.218615:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc074a80/2, rc 0, transno 4294967310 00010000:00010000:1.0:1788390441.218619:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.218623:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103243136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788390441.218653:0:8777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 12 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.218667:0:8777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 12 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.218678:0:8777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103243520:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.218734:0:8777:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046780 going to sleep for 11 seconds 00000020:00080000:3.0:1788390441.218873:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:2.0:1788390441.219043:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68a7e6d80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788390441.219049:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103243392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788390441.221166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390441.221266:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.221352:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827328 00000100:00100000:3.0:1788390441.221360:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827328 00010000:00010000:3.0:1788390441.221447:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 13 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.221487:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788390441.221497:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2357:x1875263093827328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390441.221513:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.221520:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 13 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.221534:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 13 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.221559:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390441.221563:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390441.221569:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.221578:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.221603:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390441.221645:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827200 00000100:00100000:3.0:1788390441.221648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2357:x1875263093827328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.221652:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827200 00000100:00100000:3.0:1788390441.221674:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788390441.221692:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788390441.221703:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+13:2357:x1875263093827200:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.221852:0:8777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd329c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeda2 expref: 13 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.221889:0:8777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103243520:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.221913:0:8777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.221924:0:8777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.221932:0:8777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.221943:0:8777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.221952:0:8777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.221999:0:8777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390441.222011:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390441.222019:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.222042:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390441.222047:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.222057:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.222071:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.222078:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd32c12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.222100:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390441.222110:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390441.222113:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390441.222711:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3288:x1875263103243264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4164us (5023us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788390441.222721:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788390441.224056:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68a7e5180/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788390441.224068:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103243264:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788390441.240793:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1788390441.240825:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788390441.240832:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788390441.240945:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093827200:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 19239us (19782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.240958:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788390441.245227:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.245459:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827584 00000100:00100000:3.0:1788390441.245469:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827584 00000100:00100000:3.0:1788390441.245542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:3.0:1788390441.245556:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11621:x1875263093827584:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390441.245613:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.245641:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32bf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee3c expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.245661:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:3.0:1788390441.245667:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390441.245698:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.245713:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.245722:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390441.245953:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000341f3774 reply state 00000000070905a3 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.246245:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390441.247486:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:11621:x1875263093827584:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1915us (2248us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788390441.247499:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00010000:00010000:1.0:1788390441.248824:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248852:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248860:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248865:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.248870:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248877:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248892:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.248895:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390441.248899:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.248905:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd32c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.249467:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.249598:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827712 00000100:00100000:3.0:1788390441.249609:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827712 00000100:00100000:3.0:1788390441.249668:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390441.249679:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2356:x1875263093827712:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788390441.249905:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788390441.249909:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788390441 -> 1788390441 00002000:00010000:3.0:1788390441.249911:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788390441 00002000:00010000:3.0:1788390441.249913:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788390441 -> 1788390441 00002000:00010000:3.0:1788390441.249915:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788390441.249993:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2356:x1875263093827712:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 315us (529us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788390441.250001:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1788390441.252190:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.252397:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093827968 00000100:00100000:1.0:1788390441.252407:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093827968 00000100:00100000:1.0:1788390441.252518:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:1.0:1788390441.252531:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:11621:x1875263093827968:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.252595:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.252612:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.252632:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.252666:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.252678:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 20 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.252692:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103243648:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.252767:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390441.255210:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5806:1875263103243648:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.255240:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.255421:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.255578:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828096 00000100:00100000:3.0:1788390441.255585:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828096 00010000:00010000:3.0:1788390441.255620:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.255657:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390441.255667:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:2356:x1875263093828096:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390441.255679:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.255687:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255701:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255721:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd32bda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee2e expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255754:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:3.0:1788390441.255759:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255769:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255776:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.255800:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390441.255831:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255840:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.255863:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:2356:x1875263093828096:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 194us (441us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390441.255869:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.255873:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00010000:00010000:1.0:1788390441.255882:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255889:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255901:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390441.255906:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255913:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255923:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:1.0:1788390441.255926:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788390441.255930:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.255935:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.256196:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11621:x1875263093827968:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3667us (4014us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788390441.256205:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:0.0:1788390441.258771:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.258852:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828224 00000100:00100000:1.0:1788390441.258861:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828224 00000100:00100000:1.0:1788390441.258997:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788390441.259010:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093828224:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.259052:0:8777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.259073:0:8777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.259101:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390441.259106:0:8777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390441.259111:0:8777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.259148:0:8777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 8 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.259163:0:8777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 8 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.259178:0:8777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103243776:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.259259:0:8777:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.263113:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.263295:0:8777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8777:1875263103243776:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.263344:0:8777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.263648:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828352 00000100:00100000:3.0:1788390441.263656:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828352 00010000:00010000:2.0:1788390441.263761:0:11126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 9 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.263840:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788390441.263864:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+9:2357:x1875263093828352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390441.263880:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390441.263904:0:11126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 9 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.263917:0:11126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 9 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.263940:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32c04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee4a expref: 9 pid: 8777 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.263956:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390441.263992:0:11126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390441.263999:0:11126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.264009:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.264035:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390441.264089:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093828352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 226us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.264097:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00010000:00010000:1.0:1788390441.264158:0:8777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264167:0:8777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264189:0:8777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264204:0:8777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264211:0:8777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264217:0:8777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390441.264221:0:8777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264230:0:8777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264242:0:8777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.264250:0:8777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd32c27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.264313:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2357:x1875263093828224:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5297us (5540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.264321:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1788390441.267722:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.267825:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828608 00000100:00100000:1.0:1788390441.267835:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828608 00000100:00100000:1.0:1788390441.267895:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:1.0:1788390441.267920:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11621:x1875263093828608:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390441.268115:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268134:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268146:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268543:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268554:0:8163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268562:0:8163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268593:0:8163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.268606:0:8163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 20 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.268620:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103243904:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390441.268743:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.270842:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.270912:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828736 00000100:00100000:2.0:1788390441.270920:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828736 00010000:00010000:2.0:1788390441.270954:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.271115:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:2.0:1788390441.271126:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:2356:x1875263093828736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390441.271140:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390441.271146:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.271160:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 21 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.271182:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:2.0:1788390441.271187:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.271195:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.271201:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.271218:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390441.271274:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:2356:x1875263093828736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 150us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390441.271283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00010000:00010000:1.0:1788390441.271643:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd32be8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee35 expref: 20 pid: 5806 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390441.271673:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103243904:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390441.271695:0:8163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.271704:0:8163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390441.271710:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390441.271883:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967506 00000001:00080000:1.0:1788390441.272060:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967507 00000001:00080000:1.0:1788390441.272104:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000100:00100000:1.0:1788390441.272166:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103244032:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788390441.272216:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390441.272236:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.272396:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103244032 00000100:00100000:0.0:1788390441.272402:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103244032 00000100:00100000:0.0:1788390441.272636:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390441.272645:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8163:x1875263103244032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788390441.272710:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8163:x1875263103244032:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390441.272717:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390441.272776:0:8163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788390441.272782:0:8163:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788390441.272801:0:8163:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68a7e6d80, transno 4294967321 00000100:00100000:0.0:1788390441.272844:0:8163:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d68a7e5180 x1875263103243264/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788390457 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390441.272855:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103244032:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788390441.273224:0:8163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000100:00100000:0.0:1788390441.273277:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc077800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103244160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788390441.273319:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390441.273343:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390441.273355:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103244160 00000100:00100000:0.0:1788390441.273358:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103244160 00000100:00100000:0.0:1788390441.273379:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390441.273386:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8163:x1875263103244160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788390441.273514:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8163:x1875263103244160:12345-0@lo:1000:mdt00_003.0 Request processed in 129us (195us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788390441.273522:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390441.273549:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc077800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8163:1875263103244160:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788390441.273569:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273577:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273584:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273589:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390441.273593:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273610:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273622:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d683b5af00) 00010000:00010000:0.0:1788390441.273625:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390441.273629:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273635:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd32c35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273662:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273667:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273673:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273678:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390441.273680:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273686:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273692:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390441.273694:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390441.273699:0:8163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 23 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273718:0:8163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 23 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273726:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 23 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.273745:0:8163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 23 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.273755:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103244288:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390441.273796:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390441.282018:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8163:1875263103244288:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788390441.282052:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390441.282054:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788390441.282076:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd32b78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.282109:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.282123:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.282131:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.282139:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.282220:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093828864 00000100:00100000:3.0:1788390441.282227:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093828864 00000100:00100000:3.0:1788390441.283424:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788390441.283437:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11620:x1875263093828864:12345-192.168.202.1@tcp:49:lfs.0 00010000:00010000:2.0:1788390441.283669:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284212:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284219:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390441.284223:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284232:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284309:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390441.284313:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390441.284317:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284345:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284362:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284369:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284375:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284380:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390441.284383:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284390:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284397:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390441.284399:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390441.284401:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.284405:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd32c2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.284634:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11620:x1875263093828864:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 1198us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390441.284642:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1788390441.284868:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11621:x1875263093828608:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 16949us (17153us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788390441.284876:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000020:00080000:2.0:1788390441.284886:0:8163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788390441.285199:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390441.285204:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390441.286405:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788390441.286419:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390441.294108:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390441.294160:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093829120 00000100:00100000:1.0:1788390441.294172:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093829120 00000100:00100000:1.0:1788390441.294314:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:1.0:1788390441.294325:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11620:x1875263093829120:12345-192.168.202.1@tcp:58:lfs.0 00000100:00100000:0.0:1788390441.294649:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000040:00080000:1.0:1788390441.294718:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788390441.294778:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093829376 00000100:00100000:2.0:1788390441.294783:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093829376 00000100:00100000:1.0:1788390441.294793:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+24:11620:x1875263093829120:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 471us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390441.294801:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1788390441.294811:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788390441.294817:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6ae0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:11621:x1875263093829376:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788390441.296062:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788390441.296365:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00010000:00010000:2.0:1788390441.296427:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296443:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296454:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296463:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296469:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296474:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.296500:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390441.296640:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390441.296647:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.296654:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390441.296658:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.296665:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.296752:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:0.0:1788390441.296755:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788390441.296760:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.296766:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.296780:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390441.296782:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390441.296784:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390441.296885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6ae0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:11621:x1875263093829376:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 2064us (2233us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788390441.296896:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000020:00080000:2.0:1788390441.296901:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788390441.327445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.328365:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093829504 00000100:00100000:2.0:1788390441.328392:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093829504 00000100:00100000:2.0:1788390441.328461:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:2.0:1788390441.328472:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+25:11623:x1875263093829504:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390441.328498:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390441.328520:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee51 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328588:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328603:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328614:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328629:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328636:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328641:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328877:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328889:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328898:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328938:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390441.328950:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 26 pid: 5807 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.328994:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103244416:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390441.329136:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390441.336489:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390441.336566:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093829760 00000100:00100000:2.0:1788390441.336574:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093829760 00000100:00100000:3.0:1788390441.336587:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5807:1875263103244416:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390441.336614:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390441.336632:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788390441.336641:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:5588:x1875263093829760:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788390441.336867:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:5588:x1875263093829760:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 226us (388us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788390441.336874:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788390441.339864:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390441.339951:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093829888 00000100:00100000:3.0:1788390441.339989:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093829888 00010000:00010000:3.0:1788390441.340026:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 28 pid: 5807 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.340062:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788390441.340071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:2357:x1875263093829888:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390441.340086:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390441.340092:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 28 pid: 5807 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340105:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 28 pid: 5807 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340126:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32b6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee12 expref: 28 pid: 5807 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340146:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390441.340150:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340160:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340167:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390441.340187:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390441.340348:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340357:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390441.340400:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788390441.340404:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390441.340422:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340434:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340444:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340451:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340469:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340474:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390441.340479:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340488:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340498:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390441.340501:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390441.340504:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340509:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd32c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340522:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340528:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340533:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340537:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390441.340540:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340554:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340564:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95d68641e000) 00010000:00010000:0.0:1788390441.340566:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390441.340569:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.340570:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:2357:x1875263093829888:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 498us (713us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390441.340575:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd32c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390441.340578:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00010000:00010000:0.0:1788390441.340611:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd32c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee51 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340624:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee51 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390441.340631:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390441.340633:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390441.340635:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:0.0:1788390441.340662:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11623:x1875263093829504:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 12193us (13229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390441.340669:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00010000:00010000:2.0:1788390441.421349:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390442.057162:0:12516:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390442.057173:0:12516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390442.057225:0:12516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788390442.057231:0:12516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390442.105260:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.106528:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.106567:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.106590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.106614:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.106644:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830528 00000100:00100000:3.0:1788390442.106656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830528 00000100:00100000:3.0:1788390442.106710:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830144 00000100:00100000:3.0:1788390442.106713:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830144 00000100:00100000:3.0:1788390442.106738:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1788390442.106747:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093830528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390442.106813:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093830528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390442.106820:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1788390442.106836:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390442.106841:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:2358:x1875263093830144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390442.106864:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:2358:x1875263093830144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390442.106869:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390442.106883:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830272 00000100:00100000:3.0:1788390442.106885:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830272 00000100:00100000:3.0:1788390442.106903:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830400 00000100:00100000:3.0:1788390442.106905:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830400 00000100:00100000:3.0:1788390442.106918:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1788390442.106923:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093830272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390442.106951:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093830272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390442.106957:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1788390442.106981:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788390442.106987:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093830400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390442.107004:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093830400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390442.107009:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00080000:3.0:1788390442.107020:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390442.107024:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390442.109374:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830016 00000100:00100000:2.0:1788390442.109449:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830016 00000100:00100000:2.0:1788390442.109550:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:2.0:1788390442.109562:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093830016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390442.109632:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093830016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (4382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390442.109651:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 279 00000040:00080000:0.0:1788390442.317380:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390442.317390:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390442.317429:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788390442.317436:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390442.317558:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc074380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103244544:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390442.317654:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390442.323894:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390442.324002:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830656 00000100:00100000:3.0:1788390442.324010:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830656 00000100:00100000:0.0:1788390442.324019:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc074380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11638:1875263103244544:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390442.324072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:3.0:1788390442.324085:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11635:x1875263093830656:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390442.324128:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390442.324998:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11635:x1875263093830656:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 912us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390442.325009:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:3.0:1788390442.327901:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390442.327992:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093830912 00000100:00100000:0.0:1788390442.328003:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093830912 00000100:00100000:0.0:1788390442.328069:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:0.0:1788390442.328081:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+26:11635:x1875263093830912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390442.328102:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390442.328124:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32c66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee58 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.328223:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.328251:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.328265:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390442.328277:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788390442.328414:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd32c66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee58 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.328432:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee58 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.328441:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390442.328444:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390442.328460:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788390442.328523:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:11635:x1875263093830912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 443us (630us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788390442.328531:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:1.0:1788390442.334342:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390442.334484:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390442.334569:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093831296 00000100:00100000:0.0:1788390442.334581:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093831296 00000100:00100000:0.0:1788390442.334656:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390442.334667:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:2357:x1875263093831296:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390442.334683:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390442.334723:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd32c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee58 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390442.334746:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390442.334751:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390442.334811:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:2357:x1875263093831296:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390442.334819:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390442.335674:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093831168 00000100:00100000:3.0:1788390442.335681:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093831168 00000100:00100000:3.0:1788390442.335824:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:3.0:1788390442.335834:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+27:11635:x1875263093831168:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788390442.335903:0:8163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.335934:0:8163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.335945:0:8163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336178:0:8163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336187:0:8163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336194:0:8163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336200:0:8163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390442.336204:0:8163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336211:0:8163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336221:0:8163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390442.336225:0:8163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390442.336229:0:8163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390442.336235:0:8163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390442.336437:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:11635:x1875263093831168:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 604us (2114us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788390442.336450:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000040:00080000:1.0:1788390442.336869:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390442.336875:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390442.337577:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788390442.337587:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390442.338806:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390442.339058:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093831552 00000100:00100000:2.0:1788390442.339068:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093831552 00000100:00100000:2.0:1788390442.339125:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788390442.339136:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+28:11635:x1875263093831552:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390442.339394:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:11635:x1875263093831552:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 258us (593us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788390442.339402:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1788390442.445287:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390442.445314:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103244672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390442.445397:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390442.445623:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390442.445693:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103244672 00000100:00100000:0.0:1788390442.445701:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103244672 00000100:00100000:0.0:1788390442.445789:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788390442.445799:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103244672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390442.445833:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390442.445887:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103244672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390442.445894:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390442.445992:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103244672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390443.475042:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390443.749850:0:12567:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390443.749859:0:12567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390443.749911:0:12567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788390443.749918:0:12567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390443.868508:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390443.870413:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093831808 00000100:00100000:3.0:1788390443.870427:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093831808 00000100:00100000:3.0:1788390443.870527:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:3.0:1788390443.870539:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+29:11656:x1875263093831808:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390443.870566:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390443.870588:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee5f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.870689:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32c89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.870704:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32c89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.870715:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32c89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390443.870725:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788390443.870837:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1200/0x9aafc5f04cd32c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee5f expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.870855:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32c89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee5f expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.870875:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390443.870878:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788390443.870882:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390443.870955:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11656:x1875263093831808:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 418us (2457us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788390443.870981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:3.0:1788390443.874594:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390443.874626:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093831936 00000100:00100000:3.0:1788390443.874635:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093831936 00000100:00100000:3.0:1788390443.874680:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:3.0:1788390443.874689:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11656:x1875263093831936:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390443.874752:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874769:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874779:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874805:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874812:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874819:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874834:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390443.874838:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874845:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874857:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390443.874860:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390443.874864:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.874869:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1600/0x9aafc5f04cd32c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390443.874929:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+31:11656:x1875263093831936:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 241us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.874937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:0.0:1788390443.952139:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390443.952273:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832064 00000100:00100000:3.0:1788390443.952292:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832064 00000100:00100000:3.0:1788390443.952426:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1788390443.952441:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2359:x1875263093832064:12345-192.168.202.1@tcp:101:cat.0 00000100:00080000:2.0:1788390443.952444:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390443.952462:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390443.952484:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32c9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee66 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390443.952512:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a98ac29, atime: 0x6a98ac29, ctime: 0x6a98ac29, blocks: 0xb 00010000:00010000:3.0:1788390443.952530:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=261s v=(0 0) 00010000:00010000:3.0:1788390443.952542:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390443.952552:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee66 expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.952574:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee66 expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390443.952588:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:3.0:1788390443.952649:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2359:x1875263093832064:12345-192.168.202.1@tcp:101:cat.0 Request processed in 212us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.952656:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788390443.956500:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390443.956715:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832192 00000100:00100000:0.0:1788390443.956725:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832192 00002000:00100000:0.0:1788390443.956790:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff95d6bc03d880 x1875263093832192/t0(0) o3->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:59/0 lens 488/0 e 0 to 0 dl 1788390454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390443.956800:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc03d880 with x1875263093832192 ext(0->4095) 00002000:00010000:0.0:1788390443.956806:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc03d880 00000100:00100000:0.0:1788390443.956842:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390443.956852:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093832192:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:0.0:1788390443.957107:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+8:2357:x1875263093832192:12345-192.168.202.1@tcp:3:cat.0 Request processed in 255us (616us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788390443.957114:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00002000:00100000:0.0:1788390443.957121:0:6657:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff95d6bc03d880 x1875263093832192/t0(0) o3->c1107d28-9e62-443d-a57b-8cc59c78a09a@192.168.202.1@tcp:59/0 lens 488/4536 e 0 to 0 dl 1788390454 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390443.957130:0:6657:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc03d880 with x1875263093832192 ext(0->4095) 00002000:00010000:0.0:1788390443.957134:0:6657:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc03d880 00000001:00080000:1.0:1788390444.004933:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788390444.004946:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1788390444.493097:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390445.517744:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103245056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.517838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390445.517908:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390445.517914:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103245184:0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.517943:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390445.518030:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245056 00000100:00100000:0.0:1788390445.518155:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103244800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518277:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390445.518315:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103245312:0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390445.518356:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788390445.518361:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103244928:0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518384:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390445.518399:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103245440:0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518420:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390445.518484:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103244800 00000100:00100000:0.0:1788390445.518491:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103244800 00000100:00100000:0.0:1788390445.518579:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788390445.518597:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103244800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518654:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3288:x1875263103244800:12345-0@lo:400:kworker.0 Request processed in 66us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.518662:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788390445.518702:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245184 00000100:00100000:0.0:1788390445.518706:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245184 00000100:00100000:0.0:1788390445.518741:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245440 00000100:00100000:0.0:1788390445.518744:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245440 00000100:00100000:0.0:1788390445.518766:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390445.518773:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103245184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518811:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103245184:12345-0@lo:400:kworker.0 Request processed in 38us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.518818:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390445.518830:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788390445.518837:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103245440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.518864:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103245440:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.518870:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788390445.518890:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390445.518894:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390445.518924:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788390445.518930:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68f5aa680, transno 4294967307 00000004:00080000:0.0:1788390445.518942:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788390445.518989:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc074a80, transno 4294967310 00000100:00100000:0.0:1788390445.518997:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103245440:0@lo:400:kworker.0 00000100:00100000:0.0:1788390445.519018:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103244800:0@lo:400:kworker.0 00010000:00010000:2.0:1788390445.519367:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390445.520013:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245056 00000100:00100000:3.0:1788390445.520085:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245312 00000100:00100000:3.0:1788390445.520089:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245312 00000100:00100000:3.0:1788390445.520107:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103244928 00000100:00100000:3.0:1788390445.520109:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103244928 00000100:00100000:3.0:1788390445.520125:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390445.520134:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103245056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.520298:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103245056:12345-0@lo:400:kworker.0 Request processed in 154us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390445.520306:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390445.520336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390445.520343:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103245312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.520399:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103245312:12345-0@lo:400:kworker.0 Request processed in 56us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390445.520405:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390445.520416:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788390445.520422:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103244928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.520451:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103244928:12345-0@lo:400:kworker.0 Request processed in 30us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390445.520456:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788390445.520493:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390445.520529:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103245184:0@lo:400:kworker.0 00000100:00100000:3.0:1788390445.520541:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103245056:0@lo:400:kworker.0 00000100:00100000:1.0:1788390445.520838:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103244928:0@lo:400:kworker.0 00000100:00100000:1.0:1788390445.520854:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103245312:0@lo:400:kworker.0 00000100:00100000:2.0:1788390446.030141:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390446.030171:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103245568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390446.030281:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390446.030381:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245568 00000100:00100000:2.0:1788390446.030391:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245568 00000100:00100000:2.0:1788390446.030442:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390446.030452:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103245568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390446.030497:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390446.030547:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103245568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.030568:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390446.030621:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103245568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788390446.556649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788390446.590067:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:2.0:1788390446.590092:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d683389f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788390446.590098:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d686e60300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6833896c0 00000020:00080000:2.0:1788390446.590102:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d686e60500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d6bc071800 00000001:00080000:2.0:1788390446.590151:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:2.0:1788390446.590194:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1788390446.590215:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788390446.592039:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788390446.592084:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000020:00080000:3.0:1788390446.592378:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788390446.592657:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788390447.119178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390447.121900:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832320 00000100:00100000:1.0:1788390447.121917:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832320 00000100:00100000:1.0:1788390447.122051:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:1.0:1788390447.122065:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11310:x1875263093832320:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788390447.122166:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11310:x1875263093832320:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 106us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.122173:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00080000:3.0:1788390447.123605:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390447.130125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390447.130351:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832576 00000100:00100000:1.0:1788390447.130361:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832576 00000100:00100000:1.0:1788390447.130420:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788390447.130431:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+18:11310:x1875263093832576:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390447.130771:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:11310:x1875263093832576:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 341us (656us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788390447.130779:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1788390447.222693:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390447.222738:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390447.222772:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390447.222810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390447.222851:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832960 00000100:00100000:3.0:1788390447.222860:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832960 00000100:00100000:1.0:1788390447.222906:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832832 00000100:00100000:1.0:1788390447.222911:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832832 00000100:00100000:2.0:1788390447.222991:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093832704 00000100:00100000:2.0:1788390447.222997:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093832704 00000100:00100000:3.0:1788390447.223004:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390447.223018:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093832960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390447.223033:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:2.0:1788390447.223042:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093832704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390447.223087:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68529cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2358:x1875263093832960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.223092:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390447.223203:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093833088 00000100:00100000:3.0:1788390447.223216:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093833088 00000100:00080000:0.0:1788390447.223261:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390447.223264:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390447.223266:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390447.223402:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390447.223409:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093833088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390447.223415:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788390447.223427:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093832832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390447.223480:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2358:x1875263093832704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 438us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.223487:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:3.0:1788390447.223619:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2358:x1875263093833088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 211us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.223624:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788390447.224008:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2358:x1875263093832832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 583us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.224015:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788390447.287062:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390447.288518:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093833216 00000100:00100000:1.0:1788390447.288532:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093833216 00000100:00100000:1.0:1788390447.288602:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:1.0:1788390447.288614:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+5:12107:x1875263093833216:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1788390447.288633:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390447.288654:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee6d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288716:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288729:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288742:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390447.288790:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390447.288795:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390447.288817:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288841:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63c00/0x9aafc5f04cd32ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee6d expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288872:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee6d expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.288881:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:1.0:1788390447.288884:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390447.288888:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390447.288948:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1ff6842-4530-4584-9014-31d80c6aefa2+6:12107:x1875263093833216:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 336us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.288954:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00010000:00010000:2.0:1788390447.565176:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390447.565267:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103245696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390447.565359:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390447.565571:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245696 00000100:00100000:3.0:1788390447.565579:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245696 00000100:00100000:3.0:1788390447.565771:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390447.565782:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103245696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390447.565819:0:6655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390447.565875:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103245696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.565884:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390447.565940:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788390447.565949:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68a7e5180, transno 4294967322 00000004:00080000:1.0:1788390447.565983:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788390447.566021:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103245696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390447.566062:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390448.592455:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390449.229376:0:12768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:07:28 (1788390448) 00010000:00010000:3.0:1788390449.614174:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390450.509230:0:11638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390450.509259:0:11638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390450.509367:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788390450.509375:0:11638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788390450.637083:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390450.637200:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246208:0@lo:400:kworker.0 00000100:00100000:2.0:1788390450.637232:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103246080:0@lo:400:kworker.0 00000100:00100000:3.0:1788390450.637281:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390450.637281:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390450.637362:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103245952:0@lo:400:kworker.0 00000100:00100000:2.0:1788390450.637367:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246080 00000100:00100000:2.0:1788390450.637374:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246080 00000100:00100000:0.0:1788390450.637390:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390450.637407:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103246464:0@lo:400:kworker.0 00000100:00100000:2.0:1788390450.637422:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245952 00000100:00100000:2.0:1788390450.637425:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245952 00000100:00100000:0.0:1788390450.637427:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390450.637446:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788390450.637449:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788390450.637454:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103246080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637454:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103245824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637486:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390450.637501:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103246080:12345-0@lo:400:kworker.0 Request processed in 48us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.637506:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103246336:0@lo:400:kworker.0 00000100:00100000:2.0:1788390450.637508:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788390450.637523:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788390450.637525:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390450.637529:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103245952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637544:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246208 00000100:00100000:0.0:1788390450.637547:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246208 00000100:00100000:2.0:1788390450.637557:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103245952:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390450.637563:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390450.637571:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246336 00000100:00100000:0.0:1788390450.637571:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246464 00000100:00100000:2.0:1788390450.637574:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246336 00000100:00100000:0.0:1788390450.637574:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246464 00000100:00100000:2.0:1788390450.637589:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788390450.637593:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390450.637594:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103246336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637606:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390450.637618:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103246336:12345-0@lo:400:kworker.0 Request processed in 24us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390450.637624:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788390450.637650:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246208:12345-0@lo:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.637656:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390450.637668:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788390450.637674:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103246464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637699:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103246464:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.637705:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788390450.637724:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103245824 00000100:00100000:0.0:1788390450.637727:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103245824 00000100:00100000:0.0:1788390450.637752:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788390450.637759:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103245824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637788:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103245824:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.637794:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788390450.637841:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103245824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637854:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103246336:0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637864:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103245952:0@lo:400:kworker.0 00000100:00100000:0.0:1788390450.637872:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103246464:0@lo:400:kworker.0 00000100:00080000:0.0:1788390450.637915:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390450.637919:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390450.637921:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390450.637936:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103246080:0@lo:400:kworker.0 00000100:00100000:3.0:1788390450.640857:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390451.149496:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390451.149522:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390451.149592:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390451.149816:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246592 00000100:00100000:2.0:1788390451.149825:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246592 00000100:00100000:2.0:1788390451.149876:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788390451.149886:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390451.149946:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390451.150133:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390451.150141:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390451.151224:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390451.308135:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390451.309072:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093833472 00000100:00100000:3.0:1788390451.309089:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093833472 00000100:00100000:3.0:1788390451.309175:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788390451.309190:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+19:12328:x1875263093833472:12345-192.168.202.1@tcp:35:umount.0 00000100:00080000:0.0:1788390451.309339:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390451.310193:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:12328:x1875263093833472:12345-192.168.202.1@tcp:35:umount.0 Request processed in 1006us (2066us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788390451.310694:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1788390451.312504:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390451.312609:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093833728 00000100:00100000:2.0:1788390451.312621:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093833728 00000100:00100000:2.0:1788390451.312685:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1788390451.312696:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+20:12328:x1875263093833728:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1788390451.313690:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:12328:x1875263093833728:12345-192.168.202.1@tcp:35:umount.0 Request processed in 994us (1191us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788390451.313698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1788390451.319491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390451.319631:0:12478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093833984 00000100:00100000:3.0:1788390451.319641:0:12478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093833984 00000100:00100000:3.0:1788390451.319692:0:12478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788390451.319699:0:12478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a6ae2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+21:12328:x1875263093833984:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:3.0:1788390451.319942:0:12478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a6ae2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:12328:x1875263093833984:12345-192.168.202.1@tcp:35:umount.0 Request processed in 241us (517us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788390451.319950:0:12478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1788390451.323140:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390451.323376:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093834240 00000100:00100000:2.0:1788390451.323388:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093834240 00000100:00100000:2.0:1788390451.323462:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788390451.323475:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:12328:x1875263093834240:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1788390451.323810:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:12328:x1875263093834240:12345-192.168.202.1@tcp:35:umount.0 Request processed in 337us (679us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788390451.323819:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788390451.331931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390451.331988:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390451.332014:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390451.332078:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093834368 00000100:00100000:1.0:1788390451.332088:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093834368 00000100:00100000:1.0:1788390451.332146:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093834624 00000100:00100000:1.0:1788390451.332150:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093834624 00000100:00100000:1.0:1788390451.332163:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093834496 00000100:00100000:1.0:1788390451.332166:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093834496 00000100:00100000:1.0:1788390451.332183:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788390451.332194:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+15:2357:x1875263093834368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390451.332228:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390451.332259:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd31d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9f8 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390451.332278:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390451.332326:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390451.332332:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+14:2357:x1875263093834368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390451.332341:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+14:2357:x1875263093834624:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788390451.332342:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:3.0:1788390451.332355:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788390451.332366:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:3.0:1788390451.332368:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd31f38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeac3 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390451.332378:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+13:2357:x1875263093834496:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390451.332382:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390451.332389:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390451.332401:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd31c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9c0 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390451.332410:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:2357:x1875263093834624:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 73us (419us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390451.332413:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390451.332422:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390451.332439:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfe8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2357:x1875263093834496:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 62us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390451.332446:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390451.333025:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390451.333049:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093834752 00000100:00100000:1.0:1788390451.333054:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093834752 00000100:00080000:0.0:1788390451.333082:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390451.333103:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788390451.333111:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2355:x1875263093834752:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1788390451.333136:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd32003 00000100:00080000:1.0:1788390451.333145:0:6653:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390451.334610:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788390451.335234:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+2:2355:x1875263093834752:12345-192.168.202.1@tcp:9:umount.0 Request processed in 2118us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390451.335267:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00010000:00010000:0.0:1788390451.337056:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390451.341883:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390451.341996:0:8777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093835136 00000100:00100000:1.0:1788390451.342008:0:8777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093835136 00000100:00100000:1.0:1788390451.342070:0:8777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788390451.342080:0:8777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+7:2355:x1875263093835136:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1788390451.342110:0:8777:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3226b 00000020:00010000:1.0:1788390451.342118:0:8777:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d69fc68000: total 0 00000100:00080000:1.0:1788390451.342122:0:8777:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390451.342163:0:8777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788390451.342426:0:8777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1107d28-9e62-443d-a57b-8cc59c78a09a+5:2355:x1875263093835136:12345-192.168.202.1@tcp:9:umount.0 Request processed in 347us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390451.342434:0:8777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00080000:0.0:1788390451.342739:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1788390451.343087:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d69fc68000: total 0 00010000:00010000:2.0:1788390451.343127:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d69fc68000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788390451.343198:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd325f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec91 expref: 4 pid: 8777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.343253:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd32c9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee66 expref: 3 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.343289:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d69fc68000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788390451.343301:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390451.343302:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390451.343304:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390451.348684:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390451.348783:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093836160 00000100:00100000:0.0:1788390451.348793:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093836160 00000100:00100000:0.0:1788390451.348855:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:0.0:1788390451.348866:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+23:2355:x1875263093836160:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1788390451.348911:0:5807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31c9f 00000020:00010000:0.0:1788390451.348926:0:5807:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d691888800: total 0 00000100:00080000:0.0:1788390451.348929:0:5807:0:(import.c:65:import_set_state_nolock()) ffff95d5810a2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390451.348952:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967522 00000100:00100000:0.0:1788390451.349405:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1107d28-9e62-443d-a57b-8cc59c78a09a+22:2355:x1875263093836160:12345-192.168.202.1@tcp:39:umount.0 Request processed in 540us (728us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788390451.349414:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00000020:00010000:2.0:1788390451.349557:0:11621:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d691888800: total 0 00010000:00010000:2.0:1788390451.349591:0:11621:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d691888800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788390451.349622:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390451.349626:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390451.349633:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd32677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecb4 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349653:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390451.349656:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788390451.349659:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd32c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee5f expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349674:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390451.349676:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390451.349680:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd324da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec44 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349692:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390451.349695:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390451.349698:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd32c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee51 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349733:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:2.0:1788390451.349735:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390451.349739:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3265b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfecad expref: 17 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349749:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390451.349751:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390451.349754:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd31f69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead1 expref: 16 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349778:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390451.349781:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390451.349785:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd31fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeaed expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349796:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390451.349799:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390451.349802:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd3216f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeb6b expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349816:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390451.349818:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390451.349822:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd32b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee19 expref: 13 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349837:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390451.349839:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390451.349849:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd325ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec7c expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349862:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff95d68641e800) 00010000:00010000:2.0:1788390451.349864:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788390451.349868:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd325e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfec8a expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349882:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390451.349884:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390451.349888:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd31f85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfead8 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349902:0:11621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390451.349904:0:11621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390451.349908:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd32956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfed86 expref: 9 pid: 8163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.349919:0:11621:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d691888800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788390451.349928:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390451.349929:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390451.349931:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390451.662161:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788390451.698244:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:0.0:1788390451.698252:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d69fc68000/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:2.0:1788390451.698340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc68000/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-OST0000 00000020:00000080:2.0:1788390451.698530:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69fc6d800 for lustre-OST0000 00000001:00100000:1.0:1788390451.705608:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000001:00080000:1.0:1788390451.705627:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00000080:1.0:1788390451.705650:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d691888800/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00080000:1.0:1788390451.705816:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788390451.706149:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788390451.706161:0:5841:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:2.0:1788390451.706901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d691888800/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-MDT0000 00000020:00000080:2.0:1788390451.707094:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5810a2800 for lustre-MDT0000 00000100:00100000:1.0:1788390452.018425:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390452.018487:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390452.018580:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390452.018679:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093836288 00000100:00100000:0.0:1788390452.018690:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093836288 00000100:00100000:2.0:1788390452.018704:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093836416 00000100:00100000:2.0:1788390452.018711:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093836416 00000100:00100000:0.0:1788390452.018768:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093836544 00000100:00100000:0.0:1788390452.018772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093836544 00000100:00100000:2.0:1788390452.018906:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788390452.018917:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+12:2356:x1875263093836288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390452.018932:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390452.018950:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030200/0x9aafc5f04cd31d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea0d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390452.018987:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390452.019035:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+11:2356:x1875263093836288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 119us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390452.019041:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788390452.019058:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390452.019065:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+10:2356:x1875263093836416:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390452.019074:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390452.019083:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd31d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfea37 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390452.019093:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390452.019110:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+9:2356:x1875263093836416:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 46us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390452.019116:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390452.019153:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788390452.019160:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+8:2358:x1875263093836544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390452.019167:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390452.019177:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd31f31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeabc expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390452.019195:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390452.019211:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+7:2358:x1875263093836544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 52us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390452.019216:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390452.024105:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390452.024345:0:8163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093836800 00000100:00100000:2.0:1788390452.024356:0:8163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093836800 00000100:00100000:2.0:1788390452.024644:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:2.0:1788390452.024655:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+6:2355:x1875263093836800:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:2.0:1788390452.024697:0:8163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31d86 00000020:00010000:2.0:1788390452.024705:0:8163:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6b6530000: total 0 00000100:00080000:2.0:1788390452.024710:0:8163:0:(import.c:65:import_set_state_nolock()) ffff95d6b6535800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390452.024746:0:8163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967523 00000100:00080000:0.0:1788390452.026133:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390452.026515:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1ff6842-4530-4584-9014-31d80c6aefa2+5:2355:x1875263093836800:12345-192.168.202.1@tcp:39:umount.0 Request processed in 1855us (2414us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788390452.026527:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000020:00010000:3.0:1788390452.026893:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6b6530000: total 0 00010000:00010000:3.0:1788390452.026898:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390452.026939:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6b6530000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788390452.027120:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:3.0:1788390452.027124:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390452.027200:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd32cac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee6d expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390452.027229:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6b6530000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788390452.027249:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390452.027251:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390452.027253:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390452.049842:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390452.050382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837056 00000100:00100000:0.0:1788390452.050394:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837056 00000100:00100000:0.0:1788390452.050466:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:0.0:1788390452.050477:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+7:2355:x1875263093837056:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:0.0:1788390452.050525:0:5799:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31c7c 00000020:00010000:0.0:1788390452.050532:0:5799:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6bc73b800: total 0 00000100:00080000:0.0:1788390452.050536:0:5799:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788390452.050616:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f8adeaca-b4c6-45fd-8f27-5a9acbbf397a+3:2355:x1875263093837056:12345-192.168.202.1@tcp:251:umount.0 Request processed in 141us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390452.050624:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 283 00000020:00010000:3.0:1788390452.050673:0:11621:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6bc73b800: total 0 00010000:00010000:3.0:1788390452.050719:0:11621:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6bc73b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788390452.051039:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031a00/0x9aafc5f04cd31d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfe9ff expref: 2 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390452.051055:0:11621:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6bc73b800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788390452.051070:0:11621:0:(genops.c:885:class_export_put()) final put ffff95d6bc73b800/f8adeaca-b4c6-45fd-8f27-5a9acbbf397a 00010000:00010000:0.0:1788390452.051086:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390452.051087:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390452.051089:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390452.051209:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc73b800/f8adeaca-b4c6-45fd-8f27-5a9acbbf397a for MGS 00000020:00000080:3.0:1788390452.051252:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bc73f000 for MGS 00000100:00100000:3.0:1788390452.688647:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390452.688731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390452.688805:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246720 00000100:00100000:3.0:1788390452.688814:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246720 00000100:00100000:3.0:1788390452.688870:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390452.688880:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390452.688917:0:6654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390452.688979:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103246720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390452.688987:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788390452.689022:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390452.689079:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103246720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390452.692294:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390453.295735:0:12966:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788390453.313189:0:12966:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788390453.313257:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.313273:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.313283:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.313290:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.313335:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788390453.313342:0:12966:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788390453.313372:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390453.313377:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788390453.313391:0:12966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788390453.313599:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390453.313608:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.313617:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390453.313628:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.313639:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390453.313646:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390453.313654:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390453.313657:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788390453.313661:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788390453.313699:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.313705:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390453.313739:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.313746:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd31d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.313764:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390453.313767:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390453.313770:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390453.313780:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390453.313799:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103246848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390453.313866:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390453.313938:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246848 00000100:00100000:0.0:1788390453.313953:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246848 00000100:00100000:0.0:1788390453.314088:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390453.314104:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+19:3289:x1875263103246848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390453.314123:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390453.314147:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030800/0x9aafc5f04cd31d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31d01 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390453.314188:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390453.314290:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3289:x1875263103246848:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.314298:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390453.314346:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103246848:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788390453.314531:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d69052f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788390453.314824:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103246976:0@lo:39:umount.0 00000100:00100000:0.0:1788390453.314874:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390453.314926:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103246976 00000100:00100000:2.0:1788390453.314934:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103246976 00000100:00100000:2.0:1788390453.315019:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788390453.315031:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103246976:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788390453.315058:0:5807:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a8b 00000100:00080000:2.0:1788390453.315069:0:5807:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb34800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788390453.315154:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390453.315527:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1875263103246976:12345-0@lo:39:umount.0 Request processed in 324us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390453.315537:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:0.0:1788390453.315546:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d69052f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788390453.315550:0:5807:0:(genops.c:885:class_export_put()) final put ffff95d6bcb30000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788390453.315570:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103246976:0@lo:39:umount.0 00000100:00080000:3.0:1788390453.315598:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390453.315603:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390453.315619:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390453.316528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb30000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788390453.316619:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bcb34800 for lustre-MDT0000 00010000:00010000:3.0:1788390453.316943:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317102:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317111:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317180:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317273:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390453.317282:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317289:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317296:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317303:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317368:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390453.317375:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317392:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317421:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.317428:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317628:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788390453.317636:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317644:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173b400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390453.317649:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317660:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390453.317679:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390453.317687:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390453.317690:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788390453.317729:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317736:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390453.317766:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317774:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6c173b400/0x9aafc5f04cd31d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31d16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317796:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390453.317800:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317807:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390453.317810:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317818:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390453.317825:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390453.317831:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390453.317840:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788390453.317844:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788390453.317867:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317874:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788390453.317896:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788390453.317902:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317912:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6813df200/0x9aafc5f04cd31c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31c3d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390453.317926:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390453.317931:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390453.317937:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317944:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390453.317946:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.317953:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390453.317999:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390453.318005:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788390453.318009:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788390453.318024:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.318030:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390453.318045:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390453.318054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390453.318066:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390453.318069:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390453.318072:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390453.318243:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247104 00000100:00100000:1.0:1788390453.318255:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247104 00000100:00100000:1.0:1788390453.318342:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390453.318368:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+18:3288:x1875263103247104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390453.318384:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390453.318405:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd31d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31d0f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390453.318421:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390453.318461:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3288:x1875263103247104:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390453.318470:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390453.318559:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390453.318759:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390453.318799:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788390453.318807:0:12966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62200/0x9aafc5f04cd31f23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f2a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390453.318820:0:12966:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1788390453.318847:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103247232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390453.318911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390453.318952:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390453.318980:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103247360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390453.319005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.319052:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247360 00000100:00100000:1.0:1788390453.319060:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247360 00010000:00010000:3.0:1788390453.319070:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.319080:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.319090:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390453.319097:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390453.319117:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390453.319128:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+17:3286:x1875263103247360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390453.319139:0:11126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390453.319228:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cddc00/0x9aafc5f04cd31f2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31f23 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.319236:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390453.319244:0:11126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390453.319246:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.319257:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390453.319261:0:11621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.319270:0:11621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390453.319278:0:11621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390453.319284:0:11621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390453.319287:0:11621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:1.0:1788390453.319295:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3286:x1875263103247360:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390453.319305:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788390453.319311:0:11621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.319320:0:11621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390453.319343:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390453.319347:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103247360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390453.319378:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390453.319417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.319448:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247488 00000100:00100000:1.0:1788390453.319461:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247488 00000100:00100000:1.0:1788390453.319488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390453.319495:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+16:3288:x1875263103247488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390453.319502:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390453.319511:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030e00/0x9aafc5f04cd319f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd319ea expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390453.319532:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390453.319539:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390453.319541:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390453.319542:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390453.319578:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3288:x1875263103247488:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390453.319585:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390453.319613:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390453.319685:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788390453.319692:0:12966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd319ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd319f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390453.319707:0:12966:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788390453.319712:0:12966:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788390453.319715:0:12966:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788390453.319742:0:12966:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788390453.319747:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788390453.319752:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390453.319758:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788390453.319764:0:12966:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d6853b8800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390453.319770:0:12966:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d69fc05000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390453.319777:0:12966:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d6b6530000 a1ff6842-4530-4584-9014-31d80c6aefa2 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390453.319783:0:12966:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff95d6a6bd3370) has exports, disconnecting them 00000020:00080000:3.0:1788390453.319787:0:12966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d6853b8800), last request at 1788390450 00000020:00000080:3.0:1788390453.319794:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31bfe 00000100:00080000:3.0:1788390453.319811:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d6853bf000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788390453.319832:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788390453.319931:0:12966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6853b8800): rc 0 00000020:00000080:3.0:1788390453.319934:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6853b8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788390453.319952:0:12966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d69fc05000), last request at 1788390450 00000020:00000080:3.0:1788390453.319956:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b33 00000100:00080000:3.0:1788390453.319978:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d69fc00800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788390453.320011:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788390453.320071:0:12966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d69fc05000): rc 0 00000020:00000080:3.0:1788390453.320074:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d69fc05000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788390453.320080:0:12966:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba8582f2fae0 00000100:00080000:3.0:1788390453.320099:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390453.320108:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788390453.320120:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788390453.320199:0:12966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788390453.320547:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d685278800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788390453.320607:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390453.320610:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788390453.320628:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788390453.320701:0:12966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788390453.320716:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d69fc07800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788390453.320750:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d6a6bd3370) has no exports 00010000:00010000:2.0:1788390453.321329:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390453.322106:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103247616:0@lo:9:umount.0 00000020:00000080:1.0:1788390453.322130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853b8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390453.322196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc05000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390453.322258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6853bf000 for lustre-MDT0000 00000020:00000080:1.0:1788390453.322265:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69fc00800 for lustre-MDT0000 00000100:00100000:3.0:1788390453.322274:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390453.322308:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103247744:0@lo:9:umount.0 00000100:00100000:3.0:1788390453.322331:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.322398:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247616 00000100:00100000:3.0:1788390453.322399:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247744 00000100:00100000:1.0:1788390453.322409:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247616 00000100:00100000:3.0:1788390453.322416:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247744 00000100:00100000:1.0:1788390453.322468:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788390453.322478:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103247616:12345-0@lo:9:umount.0 00000100:00100000:3.0:1788390453.322500:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000020:00000080:1.0:1788390453.322510:0:6653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b8e 00000100:00100000:3.0:1788390453.322516:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103247744:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788390453.322520:0:6653:0:(import.c:65:import_set_state_nolock()) ffff95d585120800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788390453.322545:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31c67 00000001:00000004:1.0:1788390453.322556:0:6653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1788390453.322557:0:6650:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390453.322598:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788390453.322793:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103247744:12345-0@lo:9:umount.0 Request processed in 282us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390453.322801:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788390453.322820:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390453.322848:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d69fc07800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788390453.322858:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788390453.322860:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390453.322875:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103247744:0@lo:9:umount.0 00010000:00010000:3.0:1788390453.322900:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390453.323048:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390453.323344:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247232 00000100:00100000:0.0:1788390453.323352:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247232 00000100:00100000:0.0:1788390453.324193:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390453.324206:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+15:3286:x1875263103247232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390453.324233:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390453.324261:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813de400/0x9aafc5f04cd31c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31c36 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390453.324285:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390453.324387:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3286:x1875263103247232:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (5474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.324396:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390453.324505:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103247616:12345-0@lo:9:umount.0 Request processed in 2022us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390453.324517:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788390453.324527:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103247232:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788390453.324674:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d685278800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788390453.324687:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788390453.324690:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788390453.324693:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103247616:0@lo:9:umount.0 00000020:00080000:0.0:1788390453.331023:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d6a6bd3370) has no exports 00000020:00000080:0.0:1788390453.366506:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a45 00000020:00000080:0.0:1788390453.366540:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6b6414000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788390453.366564:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788390453.366903:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6414000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788390453.366933:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390453.366942:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788390453.366946:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff95d68a8e8000) has no exports 00000020:00000080:1.0:1788390453.367215:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a3e 00000020:00000080:1.0:1788390453.367230:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6b640c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788390453.367300:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390453.367307:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788390453.367310:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6b6409800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788390453.367313:0:12966:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6409800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788390453.367318:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788390453.367670:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788390453.709063:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390454.273728:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1107d28-9e62-443d-a57b-8cc59c78a09a 00000020:00000080:1.0:1788390454.273738:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d69fc6f800/c1107d28-9e62-443d-a57b-8cc59c78a09a 00000001:00100000:1.0:1788390454.273773:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390454.273776:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6bc738800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390454.273980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc6f800/c1107d28-9e62-443d-a57b-8cc59c78a09a for lustre-OST0001 00000020:00000080:2.0:1788390454.274030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc738800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788390454.274051:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69fc6e800 for lustre-OST0001 00000020:00000080:2.0:1788390454.274057:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bc73d800 for lustre-OST0001 00010000:00010000:3.0:1788390454.735495:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390455.757357:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390455.757448:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103248128:0@lo:400:kworker.0 00000100:00100000:1.0:1788390455.757532:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390455.757599:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390455.757606:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103248000:0@lo:400:kworker.0 00000100:00100000:1.0:1788390455.757631:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390455.757661:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103248128 00000100:00100000:1.0:1788390455.757669:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103248128 00000100:00100000:1.0:1788390455.757717:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103248000 00000100:00100000:1.0:1788390455.757721:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103248000 00000100:00100000:1.0:1788390455.757735:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788390455.757743:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875263103248128:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788390455.757752:0:5805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788390455.757797:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788390455.757798:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3287:x1875263103248128:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788390455.757809:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3287:x1875263103248000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390455.757810:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00080000:2.0:1788390455.757818:0:8163:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788390455.757855:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3287:x1875263103248000:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788390455.757862:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788390455.757879:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390455.757885:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390455.757891:0:3287:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00010000:2.0:1788390455.757934:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390455.760409:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247872:0@lo:400:kworker.0 00000100:00100000:3.0:1788390455.760487:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390455.760571:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103247872 00000100:00100000:0.0:1788390455.760581:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103247872 00000100:00100000:0.0:1788390455.760739:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788390455.760751:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103247872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390455.760821:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9+14:3288:x1875263103247872:12345-0@lo:400:kworker.0 Request processed in 73us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390455.760828:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788390455.760906:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103247872:0@lo:400:kworker.0 00000100:00080000:1.0:1788390455.765171:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390455.765184:0:3287:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 118 00000100:00080000:1.0:1788390455.765192:0:3287:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d6bcb32800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390455.765240:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e4000 x1875263103248256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390455.765273:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103248000:0@lo:400:kworker.0 00000100:00080000:1.0:1788390455.765304:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390455.765308:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390455.765311:0:3287:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788390455.765315:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390455.765318:0:3287:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 136 00000100:00080000:1.0:1788390455.765322:0:3287:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5810a6800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390455.765333:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e4700 x1875263103248384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390455.765339:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103248256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788390455.765348:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103248128:0@lo:400:kworker.0 00000100:00100000:2.0:1788390455.765411:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390455.765447:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103248384:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788390455.765453:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103248256 00000100:00100000:1.0:1788390455.765459:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103248256 00000100:00100000:2.0:1788390455.765474:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390455.765507:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103248384 00000100:00100000:1.0:1788390455.765511:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103248384 00000100:00100000:1.0:1788390455.765530:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788390455.765539:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103248256:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788390455.765546:0:8163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788390455.765555:0:5807:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788390455.765557:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788390455.765557:0:8163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3285:x1875263103248384:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788390455.765573:0:5805:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788390455.765574:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:02000000:0.0:1788390455.765574:0:8163:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788390455.765627:0:8163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3285:x1875263103248384:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 71us (152us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390455.765636:0:8163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788390455.765657:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390455.765665:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390455.765671:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103248384:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788390455.772672:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103248256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7125us (7254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390455.772695:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788390455.772713:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390455.772721:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390455.772727:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103248256:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788390456.781342:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788390456.804920:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1ff6842-4530-4584-9014-31d80c6aefa2 00000001:00080000:0.0:1788390456.804937:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00000080:0.0:1788390456.804942:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d6b6530000/a1ff6842-4530-4584-9014-31d80c6aefa2 00000020:00000080:0.0:1788390456.804983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6530000/a1ff6842-4530-4584-9014-31d80c6aefa2 for lustre-MDT0000 00000020:00000080:0.0:1788390456.805036:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6b6535800 for lustre-MDT0000 00000001:00100000:0.0:1788390456.834863:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390456.834874:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d585124000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390456.834943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585124000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788390456.835017:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d585120800 for lustre-OST0000 00010000:00010000:3.0:1788390457.805266:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390458.829182:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788390459.406365:0:12966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bbd47f60 - data ffff95d692718d80/ffff95d68f776000 00000020:01000000:1.0:1788390459.406523:0:12966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc25fcc0 - data ffff95d6b8fa8af8/ffff95d6b486ec00 00000001:00000004:1.0:1788390459.414465:0:12966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00080000:1.0:1788390459.453740:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788390459.453749:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788390459.453770:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390459.453773:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788390459.455097:0:6757:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788390459.455103:0:6757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788390459.455112:0:6757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788390459.456105:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788390459.456109:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788390459.456121:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390459.456123:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788390459.456432:0:8020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788390459.456437:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788390459.456447:0:8020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788390459.492802:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a0d 00000020:00000080:2.0:1788390459.492815:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb37800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390459.493729:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a22 00000020:00000080:3.0:1788390459.493736:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb46000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390459.493742:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788390459.493749:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.493757:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390459.493761:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff95d6a6bd0000) has no exports 00000004:01000000:3.0:1788390459.493920:0:12966:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788390459.493930:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31c60 00000020:00000080:3.0:1788390459.493950:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d5810a4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390459.493953:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788390459.493957:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.494001:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788390459.494003:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff95d6bc75cd28) has no exports 00000020:00000080:3.0:1788390459.494009:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31c59 00000020:00000080:3.0:1788390459.494013:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d69fc06800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788390459.494365:0:12966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788390459.494369:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390459.494374:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788390459.494380:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390459.494382:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390459.494415:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.494422:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390459.494429:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b79 00000020:00000080:3.0:1788390459.494436:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d69fc02800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390459.494441:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788390459.494444:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.494447:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788390459.494449:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d68a8ecd28) has no exports 00000020:00000080:3.0:1788390459.494453:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b72 00000020:00000080:3.0:1788390459.494456:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d68527d800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788390459.494769:0:12966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788390459.494772:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390459.494773:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788390459.494776:0:12966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390459.494777:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390459.494797:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.494800:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390459.494820:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.494822:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390459.494841:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a29 00000020:00000080:3.0:1788390459.494849:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb41800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788390459.494851:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788390459.494853:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.494855:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390459.494857:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff95d6a6bd4d28) has no exports 00000020:00000080:3.0:1788390459.494869:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.494870:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788390459.494873:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a30 00000020:00000080:3.0:1788390459.494874:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb40800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788390459.494880:0:12966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6a0d90000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788390459.494883:0:12966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a0d90000 3 00000020:01000004:3.0:1788390459.494885:0:12966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d6a0d90000 from lustre-MDT0000 00000020:00000080:3.0:1788390459.494898:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.494900:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788390459.494902:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb36800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788390459.494904:0:12966:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb36800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788390459.494910:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788390459.494999:0:12966:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788390459.495003:0:12966:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788390459.495005:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788390459.495008:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.495011:0:12966:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390459.495017:0:12966:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff95d68a92f000 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390459.495023:0:12966:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff95d6a6bd19b8) has exports, disconnecting them 00000020:00080000:3.0:1788390459.495027:0:12966:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95d68a92f000), last request at 1788390288 00000020:00000080:3.0:1788390459.495041:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd319ce 00000020:00010000:3.0:1788390459.495045:0:12966:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d68a92f000: total 8 00000100:00080000:3.0:1788390459.495049:0:12966:0:(import.c:65:import_set_state_nolock()) ffff95d68a928000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788390459.495066:0:12966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d68a92f000): rc 0 00000020:00080000:3.0:1788390459.495070:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff95d6a6bd19b8) has no exports 00000100:00100000:3.0:1788390459.495184:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff95d6a3291800:5800] 1 exiting: rc = 0 00000020:00010000:2.0:1788390459.495385:0:11621:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d68a92f000: total 8 00010000:00010000:2.0:1788390459.495413:0:11621:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d68a92f000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788390459.495434:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6813dfa00/0x9aafc5f04cd31ae6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31adf expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495448:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031800/0x9aafc5f04cd31d24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31d1d expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495456:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680031400/0x9aafc5f04cd31cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31cc9 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495463:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63800/0x9aafc5f04cd31f0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31f07 expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495469:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd31cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31cd7 expref: 5 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495475:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd31f1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31f15 expref: 4 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495485:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d680030000/0x9aafc5f04cd31cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31ce5 expref: 3 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495492:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd31cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd31cf3 expref: 2 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.495507:0:11621:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d68a92f000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788390459.495515:0:11621:0:(genops.c:885:class_export_put()) final put ffff95d68a92f000/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 00010000:00010000:2.0:1788390459.495520:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390459.495521:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390459.495522:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390459.495540:0:5799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff95d683a7fe00:5799] 0 exiting: rc = 1 00000020:00000080:1.0:1788390459.495909:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390459.495925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb46000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788390459.495930:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6bcb30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390459.495934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb30800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788390459.495937:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390459.496184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5810a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788390459.496191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc06800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390459.496197:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69fc07800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788390459.496203:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6bcb36000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390459.496205:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb36000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788390459.496208:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390459.496240:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc02800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788390459.496255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68527d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390459.496259:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d685278800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788390459.496264:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6a6b1d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390459.496266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b1d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788390459.496269:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390459.496329:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb41800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788390459.496332:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6bcb44800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788390459.496334:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb44800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788390459.496337:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788390459.496489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390459.496495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a92f000/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 for MGS 00000020:00000080:1.0:1788390459.496535:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68a928000 for MGS 00000100:00100000:0.0:1788390459.496888:0:5801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff95d6b3219e00:5801] 2 exiting: rc = 0 00000100:00100000:3.0:1788390459.497499:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497516:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497523:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497528:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497535:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497540:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497546:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497552:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497559:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497565:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497570:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497576:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497581:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497587:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497592:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497598:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497603:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497608:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497612:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497618:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497624:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497629:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497634:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497640:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497645:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497650:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497655:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497659:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497664:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497669:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497674:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497678:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497684:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497688:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497694:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497699:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497712:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497717:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497722:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497727:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497732:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497737:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497742:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497747:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497752:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497757:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497761:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497766:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497771:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497777:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497783:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497789:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497793:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497798:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497803:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497808:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497813:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497818:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497823:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497828:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497833:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497839:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497844:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.497849:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788390459.498395:0:12966:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788390459.498399:0:12966:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788390459.499542:0:12966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc261c60 - data ffff95d5878736c0/ffff95d68a822c00 00000020:01000000:3.0:1788390459.499669:0:12966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6b2f199c0 - data ffff95d6b8f6d0d8/ffff95d686656800 00000020:00000080:3.0:1788390459.500206:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd319b2 00000020:00000080:3.0:1788390459.500215:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d68a5b1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788390459.500234:0:12966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6a0d90000 from MGS, refs=2 00000020:01000004:3.0:1788390459.500246:0:12966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a0d90000 2 00000020:01000004:3.0:1788390459.500250:0:12966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d6a0d90000 from MGS 00000020:00000080:3.0:1788390459.500272:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.500278:0:12966:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788390459.500281:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d68a5b3800/MGS 00000020:00000080:3.0:1788390459.500284:0:12966:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5b3800/MGS for MGS 00000020:01000000:3.0:1788390459.500291:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788390459.500342:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788390459.500346:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.500351:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390459.500357:0:12966:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95d6bcb45800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390459.500363:0:12966:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff95d691808000) has exports, disconnecting them 00000020:00080000:3.0:1788390459.500367:0:12966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95d6bcb45800), last request at 1788390289 00000020:00000080:3.0:1788390459.500371:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31a7d 00000020:00080000:3.0:1788390459.500381:0:12966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6bcb45800): rc 0 00000020:00000080:3.0:1788390459.500385:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d6bcb45800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788390459.500977:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390459.500984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb45800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788390459.513697:0:12966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788390459.513707:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390459.513711:0:12966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788390459.513719:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390459.513945:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390459.513955:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788390459.514088:0:12966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a0d90000 1 00000020:00000080:3.0:1788390459.514095:0:12966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd319a4 00000020:00000080:3.0:1788390459.514104:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d68a5b2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788390459.514146:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69052f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788390459.514153:0:36:0:(genops.c:885:class_export_put()) final put ffff95d6bcb45000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788390459.514156:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb45000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788390459.514170:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788390459.514536:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788390459.514542:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390459.514547:0:12966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390459.514552:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff95d68a664d28) has no exports 00000020:00000080:1.0:1788390459.514624:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788390459.526730:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390459.526744:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788390459.526749:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d688579000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788390459.526754:0:12966:0:(genops.c:844:class_export_destroy()) destroying export ffff95d688579000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788390459.526764:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788390459.526903:0:12966:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d686a43800 00000020:01000000:2.0:1788390459.526927:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788390459.526931:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390459.526936:0:12966:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788390459.526941:0:12966:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff95d68a6619b8) has no exports 00000100:00100000:3.0:1788390459.527065:0:5807:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff95d6b327d600:5807] 2 exiting: rc = 0 00000100:00100000:2.0:1788390459.527079:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff95d68a6d4600:5806] 1 exiting: rc = 0 00000100:00100000:3.0:1788390459.527150:0:12968:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff95d6846d7400:12968] 4 exiting: rc = 0 00000100:00100000:0.0:1788390459.527398:0:8163:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff95d6a69c7400:8163] 3 exiting: rc = 0 00000100:00100000:1.0:1788390459.532472:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff95d6b327d200:5805] 0 exiting: rc = 1 00000100:00100000:2.0:1788390459.532696:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532707:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532716:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532724:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532731:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532738:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532747:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532757:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532764:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532772:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532779:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532787:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532794:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532803:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532825:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532836:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532845:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532852:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532857:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532868:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532875:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532882:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532888:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532894:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532938:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.532950:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533038:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533049:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533056:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533062:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533134:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533142:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533150:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533224:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533237:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533243:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533251:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533257:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533298:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533309:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533318:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533327:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533335:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533343:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533351:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533359:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533367:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533377:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533384:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533399:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533408:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533417:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533426:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533433:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533441:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533452:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533461:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533470:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533481:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533487:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533493:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533504:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533511:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.533516:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.537721:0:12478:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff95d68f5b0a00:12478] 2 exiting: rc = 0 00000100:00100000:1.0:1788390459.537735:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95d6a6b94600:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1788390459.537803:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95d6a6b95800:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1788390459.538988:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539001:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539013:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539024:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539033:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539044:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539053:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539073:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539084:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539094:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539100:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539149:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539171:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539178:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539183:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539189:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539194:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539200:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539205:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539211:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539226:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539231:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539237:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539242:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539248:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539253:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539259:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539264:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539270:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539275:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539279:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539284:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539289:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539294:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539300:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539305:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539310:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539315:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539321:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539326:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539331:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539336:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539341:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539347:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539352:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539358:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539363:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539369:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539374:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539378:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539384:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539388:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539393:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539398:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539403:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539413:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539418:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539423:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539429:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539434:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539439:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539443:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539449:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539454:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.539851:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff95d6a6b94a00:5812] 0 exiting: rc = 1 00000100:00100000:0.0:1788390459.539926:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff95d6a6b95600:5813] 1 exiting: rc = 0 00000100:00100000:2.0:1788390459.540025:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540035:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540043:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540054:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540118:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540124:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540131:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540137:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540158:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540177:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540185:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540196:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540213:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540226:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540233:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540240:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540246:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540253:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540260:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540267:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540288:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540294:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540302:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540310:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540316:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540337:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540343:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540350:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540356:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540362:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540368:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540374:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540393:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540401:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540407:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540413:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540420:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540425:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540432:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540438:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540533:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540541:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540548:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540553:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540574:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540581:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540590:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540596:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540604:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540611:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540617:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540624:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540630:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540641:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540650:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540657:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540678:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540685:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540691:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540697:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540710:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540716:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540722:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.540729:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.548310:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95d6a6b95400:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1788390459.548429:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95d6a6b94200:5815] 1 exiting: rc = 0 00000100:00100000:0.0:1788390459.548490:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548498:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548517:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548528:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548535:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548542:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548547:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548553:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548558:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548564:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548570:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548576:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548581:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548587:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548593:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548598:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548603:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548609:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548615:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548620:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548625:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548630:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548635:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548640:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548645:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548651:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548656:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548661:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548667:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548672:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548677:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548683:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548687:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548691:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548697:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548702:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548707:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548719:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548724:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548729:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548734:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548739:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548744:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548749:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548754:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548759:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548765:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548770:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548774:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548779:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548784:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548789:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548794:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548799:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548804:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548808:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548813:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548818:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548823:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548828:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548833:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548838:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548843:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.548849:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.549271:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95d6a6b94c00:5816] 0 exiting: rc = 1 00000100:00100000:3.0:1788390459.549286:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95d6a6b94000:5817] 1 exiting: rc = 0 00000100:00100000:0.0:1788390459.549440:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549446:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549451:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549457:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549462:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549467:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549473:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549479:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549493:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549499:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549504:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549510:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549515:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549520:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549525:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549529:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549533:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549536:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549540:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549544:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549548:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549554:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549559:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549564:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549570:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549576:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549582:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549587:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549591:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549596:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549601:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549607:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549613:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549618:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549623:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549628:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549633:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549637:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549641:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549645:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549648:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549652:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549656:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549665:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549668:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549672:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549676:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549680:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549683:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549686:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549689:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549692:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549696:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549699:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549703:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549706:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549710:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549713:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549716:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549719:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549722:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549725:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549728:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.549731:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390459.550013:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff95d6a6b95200:5819] 1 exiting: rc = 0 00000100:00100000:3.0:1788390459.550406:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff95d6a6b94e00:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1788390459.557318:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557602:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557614:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557626:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557637:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557648:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557660:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557671:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557682:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557694:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557705:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557716:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557728:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557738:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557749:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557759:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557769:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557780:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557792:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557802:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557813:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557824:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557835:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557845:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557857:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557868:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557879:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557889:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557900:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557910:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557932:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557943:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557953:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557985:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.557996:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558006:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558017:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558028:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558038:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558048:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558059:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558065:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558071:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558076:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558086:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558096:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558106:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558116:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558126:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558136:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558147:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558157:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558176:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558188:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558198:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558209:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558218:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558228:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558239:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558249:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558260:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558270:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558281:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390459.558291:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390459.559876:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff95d6a6942c00:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1788390459.559925:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff95d6a6942000:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1788390459.560690:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff95d68a657400:5822] 2 exiting: rc = 0 00000100:00100000:1.0:1788390459.560756:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560769:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560775:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560781:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560799:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560811:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560820:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560829:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560835:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560843:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560850:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560855:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560861:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560905:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560910:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560915:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560920:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560925:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.560935:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561012:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561023:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561030:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561038:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561045:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561054:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561060:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561183:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561189:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561194:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561213:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561220:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561226:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561231:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561237:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561243:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561248:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561253:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561260:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561265:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561279:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561285:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561290:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561295:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561300:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561306:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561311:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561316:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561321:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561326:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561331:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561337:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561342:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561348:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561367:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561374:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561379:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561383:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561389:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561394:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561399:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561404:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561409:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561415:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390459.561430:0:12966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788390459.570727:0:12966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390459.570739:0:12966:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788390459.570744:0:12966:0:(genops.c:885:class_export_put()) final put ffff95d68a5ff800/MDS_uuid 00000020:00000080:1.0:1788390459.570748:0:12966:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5ff800/MDS_uuid for MDS 00000020:01000000:1.0:1788390459.570759:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788390459.570870:0:12966:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788390459.853792:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390460.877273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390460.877285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788390460.877288:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103248512:0@lo:400:kworker.0 00000100:00080000:0.0:1788390460.877290:0:36:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390460.877299:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 272 00000100:00080000:0.0:1788390460.877305:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788390460.877313:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d6bcb32800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390460.877336:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf2d80 x1875263103248640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1788390460.877346:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103248512 offset 0 length 224: 4 00000100:00080000:0.0:1788390460.877360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390460.877371:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788390460.877373:0:36:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390460.877378:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 272 00000100:00100000:1.0:1788390460.877382:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103248640:0@lo:38:kworker.0 00000100:00080000:0.0:1788390460.877383:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788390460.877391:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5810a6800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390460.877408:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf0700 x1875263103248768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788390460.877598:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788390460.877723:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103248640 offset 0 length 520: 4 00000100:00100000:1.0:1788390460.877748:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103248768:0@lo:38:kworker.0 00000400:00000100:1.0:1788390460.877779:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103248768 offset 0 length 520: 4 00000020:01000004:3.0:1788390461.343579:0:13118:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788390461.360108:0:13118:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788390461.360203:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.360217:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.360223:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.360230:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.360256:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390461.360261:0:13118:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788390461.360284:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390461.360294:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf2d80 x1875263103248640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390461.360312:0:13118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788390461.360318:0:13118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788390461.360323:0:13118:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb32800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788390461.360327:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390461.360331:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf2d80 x1875263103248640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390475 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390461.360337:0:13118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390461.360352:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1788390461.360593:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103248640:0@lo:38:kworker.0 00010000:00010000:2.0:1788390461.360646:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390461.360655:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390461.360663:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390461.360667:0:11621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390461.360677:0:11621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390461.360684:0:11621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390461.360690:0:11621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390461.360693:0:11621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788390461.360696:0:11621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788390461.360732:0:11621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390461.360740:0:11621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390461.360777:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390461.360785:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd31ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cec expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390461.360793:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103248896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390461.360810:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390461.360813:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390461.360815:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390461.360862:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390461.360913:0:11126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103248896 00000100:00100000:2.0:1788390461.360922:0:11126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103248896 00000100:00100000:2.0:1788390461.361428:0:11126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390461.361437:0:11126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3289:x1875263103248896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788390461.361445:0:11126:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390461 with bad export cookie 11146345238636992974 00010000:00010000:3.0:1788390461.361609:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361616:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361658:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361663:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361675:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390461.361689:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361696:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361697:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390461.361704:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361704:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361710:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361711:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390461.361714:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361722:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.361729:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:0.0:1788390461.361729:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390461.361732:0:13118:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:0.0:1788390461.361734:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390461.361737:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788390461.361739:0:5795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:3.0:1788390461.361754:0:13118:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1788390461.361757:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788390461.361758:0:13118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788390461.361761:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788390461.361762:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1788390461.361773:0:13118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390461.361777:0:13118:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff95d6bc27cd28) has no exports 00010000:00010000:0.0:1788390461.361778:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361789:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6c173a200/0x9aafc5f04cd31cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31cfa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788390461.361799:0:13118:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff95d6bc27cd28) has no exports 00010000:00010000:0.0:1788390461.361799:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390461.361802:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361807:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390461.361810:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361817:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390461.361824:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390461.361829:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788390461.361831:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788390461.361833:0:5795:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788390461.361844:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361850:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390461.361855:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361861:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd31f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd31f1c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.361879:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390461.361880:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390461.361882:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390461.361893:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103249024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390461.361927:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390461.361955:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788390461.361989:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390461.362077:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249024 00000100:00100000:1.0:1788390461.362081:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249024 00000100:00100000:1.0:1788390461.362105:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390461.362110:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3286:x1875263103249024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788390461.362132:0:5793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390461 with bad export cookie 11146345238636992974 00000100:00100000:1.0:1788390461.362202:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3286:x1875263103249024:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (274us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390461.362209:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390461.362306:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103249152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390461.362327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390461.362401:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788390461.362405:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d682b2d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788390461.362409:0:3286:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788390461.362464:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249152 00000100:00100000:1.0:1788390461.362467:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249152 00000100:00100000:1.0:1788390461.362486:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390461.362491:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1875263103249152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788390461.362495:0:5794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390461 with bad export cookie 11146345238636992974 00000100:00100000:1.0:1788390461.362521:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1875263103249152:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (192us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390461.362526:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:01000000:3.0:1788390461.363441:0:13118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d68f695b40 - data ffff95d5878205e8/ffff95d5864fd000 00000020:01000000:3.0:1788390461.363588:0:13118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc2638a0 - data ffff95d6b8f72948/ffff95d5872c9c00 00000100:00100000:2.0:1788390461.370428:0:11126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3289:x1875263103248896:12345-0@lo:103:ldlm_bl.0 Request processed in 8983us (9559us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788390461.370462:0:11126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788390461.370486:0:3289:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788390461.377373:0:3286:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788390461.377379:0:3286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788390461.377387:0:3286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf1180 x1875263103248512/t0(0) o400->MGC192.168.202.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788390476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390461.377411:0:3286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc03c700 x1875263103248896/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390477 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390461.377418:0:3286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf3100 x1875263103249024/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390477 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390461.377423:0:3286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf3800 x1875263103249152/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390477 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390461.377473:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3288:1875263103248512:0@lo:400:kworker.0 10000000:01000000:0.0:1788390461.377492:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788390461.377501:0:3286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788390461.377502:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788390461.377527:0:3289:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff95d682b2d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788390461.377545:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3289:1875263103248896:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788390461.378871:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d682b2d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390461.378882:0:3286:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 105 00000100:00080000:0.0:1788390461.378910:0:3286:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d682b2d800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390461.379138:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e6a00 x1875263103249280/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390461.379216:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3285:1875263103249280:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788390461.379267:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103249280 offset 0 length 520: 4 00000100:00100000:1.0:1788390461.379337:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103249152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390461.379343:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3286:1875263103249024:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1788390461.392279:0:13118:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788390461.417607:0:13118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b02 00000020:00000080:3.0:1788390461.417618:0:13118:0:(genops.c:885:class_export_put()) final put ffff95d585012800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788390461.417698:0:13118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d69fc01000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788390461.417702:0:13118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d69fc01000 2 00000020:01000004:3.0:1788390461.417709:0:13118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d69fc01000 from lustre-OST0000 00000020:00000080:3.0:1788390461.417757:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390461.417767:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788390461.417770:0:13118:0:(genops.c:885:class_export_put()) final put ffff95d585015800/lustre-OST0000_UUID 00000020:00000080:3.0:1788390461.417772:0:13118:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585015800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788390461.417778:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788390461.417817:0:13118:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788390461.417821:0:13118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788390461.417825:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390461.417829:0:13118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390461.417835:0:13118:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95d68a5fc800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390461.417840:0:13118:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff95d69180b370) has exports, disconnecting them 00000020:00080000:3.0:1788390461.417845:0:13118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95d68a5fc800), last request at 1788390301 00000020:00000080:3.0:1788390461.417848:0:13118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b2c 00000020:00080000:3.0:1788390461.417859:0:13118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d68a5fc800): rc 0 00000020:00000080:3.0:1788390461.417873:0:13118:0:(genops.c:885:class_export_put()) final put ffff95d68a5fc800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788390461.417897:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585012800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788390461.419466:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5fc800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788390461.421123:0:13118:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788390461.421129:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390461.421133:0:13118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788390461.421139:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390461.421418:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390461.421426:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788390461.421431:0:13118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d69fc01000 1 00000020:00000080:2.0:1788390461.421436:0:13118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31abc 00000020:00000080:2.0:1788390461.421443:0:13118:0:(genops.c:885:class_export_put()) final put ffff95d6b640b800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788390461.421448:0:13118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788390461.421452:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390461.421456:0:13118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788390461.421459:0:13118:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff95d68a8eb370) has no exports 00000020:00000080:0.0:1788390461.421577:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bcb32800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788390461.421584:0:36:0:(genops.c:885:class_export_put()) final put ffff95d6a6b6c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788390461.421586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b6c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788390461.421593:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788390461.421656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788390461.435772:0:13118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390461.435788:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788390461.435793:0:13118:0:(genops.c:885:class_export_put()) final put ffff95d69fc02000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788390461.435797:0:13118:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69fc02000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788390461.435804:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788390461.437140:0:13118:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d69fc06000 00000020:02000400:2.0:1788390461.437211:0:13118:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788390461.902130:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390462.926608:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788390463.168523:0:13267:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788390463.177031:0:13267:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788390463.177149:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177165:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177172:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177180:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177199:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788390463.177205:0:13267:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788390463.177233:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390463.177247:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf0700 x1875263103248768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390463.177263:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788390463.177287:0:13267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390463.177295:0:13267:0:(import.c:65:import_set_state_nolock()) ffff95d5810a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788390463.177301:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390463.177305:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf0700 x1875263103248768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390475 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390463.177313:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390463.177317:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1788390463.177709:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390463.177717:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177726:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390463.177731:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177742:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390463.177750:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390463.177757:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390463.177760:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788390463.177763:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788390463.177780:0:5796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682b2d800 00010000:00010000:0.0:1788390463.177785:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177792:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6c173a800/0x9aafc5f04cd31cc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31cd0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.177816:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390463.177819:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390463.177821:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390463.177914:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103248768:0@lo:38:kworker.0 00010000:00010000:0.0:1788390463.179223:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179244:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179253:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179261:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179302:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390463.179311:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179316:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179321:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179325:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.179339:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390463.179345:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1788390463.179356:0:13267:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1788390463.179357:0:11621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.179370:0:11621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc1d52c20) 00010000:00010000:1.0:1788390463.179373:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1788390463.179374:0:11621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.179380:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390463.179381:0:13267:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:3.0:1788390463.179385:0:11621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788390463.179390:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1788390463.179398:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc1d52c20) 00000020:00000080:0.0:1788390463.179402:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1788390463.179404:0:11621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390463.179404:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788390463.179408:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390463.179419:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95d6bc75b370) has no exports 10000000:01000000:3.0:1788390463.179423:0:11621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390463.179424:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390463.179430:0:11621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788390463.179433:0:11621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:00010000:1.0:1788390463.179433:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390463.179439:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788390463.179442:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788390463.179446:0:5795:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788390463.179452:0:11621:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682b2d800 00010000:00010000:3.0:1788390463.179457:0:11621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.179458:0:5795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682b2d800 00010000:00010000:1.0:1788390463.179461:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390463.179465:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95d6bc75b370) has no exports 00010000:00010000:3.0:1788390463.179466:0:11621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd31cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31cde expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.179473:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd31f07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.179485:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390463.179487:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.179487:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390463.179489:0:11621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.179489:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.179501:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788390463.184308:0:13267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bbd47d20 - data ffff95d68b3ed510/ffff95d68f775400 00000020:01000000:0.0:1788390463.184503:0:13267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc261c00 - data ffff95d584f6a948/ffff95d5852fb800 00100000:10000000:1.0:1788390463.210887:0:13267:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788390463.240528:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31bcd 00000020:00000080:2.0:1788390463.240546:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6853be800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788390463.240580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853be800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:2.0:1788390463.240634:0:13267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6a6b1a000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788390463.240639:0:13267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a6b1a000 2 00000020:01000004:2.0:1788390463.240642:0:13267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d6a6b1a000 from lustre-OST0001 00000020:00000080:2.0:1788390463.240670:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390463.240682:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788390463.240685:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6853b9800/lustre-OST0001_UUID 00000020:00000080:2.0:1788390463.240688:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853b9800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788390463.240695:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788390463.241221:0:13267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9->MGS 00010000:00010000:2.0:1788390463.241264:0:13267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390463.241279:0:13267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390463.241290:0:13267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788390463.241293:0:13267:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788390463.241297:0:13267:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788390463.241338:0:13267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682b2d800 00010000:00010000:2.0:1788390463.241342:0:13267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd31adf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31ae6 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.241364:0:13267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390463.241376:0:13267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390463.241393:0:13267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390463.241396:0:13267:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788390463.241398:0:13267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788390463.241432:0:13267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682b2d800 00010000:00010000:2.0:1788390463.241435:0:13267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdca00/0x9aafc5f04cd31d1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd31d24 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788390463.241458:0:13267:0:(import.c:65:import_set_state_nolock()) ffff95d682b2d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788390463.241467:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788390463.241469:0:13267:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788390463.241471:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788390463.241475:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788390463.241488:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d68a7e6a00 x1875263103249280/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788390471 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788390463.241524:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788390463.241528:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1788390463.241545:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8eac9fdb-0f92-42c7-bd2e-899dccb36dd9:3285:1875263103249280:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788390463.241563:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788390463.241570:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd319c0 00000020:00000080:2.0:1788390463.241575:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d68a5fe800/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 00000020:01000000:2.0:1788390463.241647:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:2.0:1788390463.241652:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390463.241659:0:13267:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788390463.241665:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff95d68a8e99b8) has no exports 00000020:00000080:3.0:1788390463.241674:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5fe800/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 for MGC192.168.202.101@tcp 10000000:01000000:0.0:1788390463.241715:0:5803:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788390463.241805:0:13267:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:2.0:1788390463.241808:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788390463.241810:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788390463.241812:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788390463.241814:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788390463.241856:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d682b2d800 for MGC192.168.202.101@tcp 00000020:00000080:2.0:1788390463.241879:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390463.241886:0:13267:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid 8eac9fdb-0f92-42c7-bd2e-899dccb36dd9) 00000020:00000080:2.0:1788390463.241888:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d682b2f000/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 00000020:00000080:2.0:1788390463.241897:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682b2f000/8eac9fdb-0f92-42c7-bd2e-899dccb36dd9 for MGC192.168.202.101@tcp 00000020:01000000:2.0:1788390463.241901:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (8eac9fdb-0f92-42c7-bd2e-899dccb36dd9) 00000020:01000000:3.0:1788390463.242376:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788390463.242381:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390463.242387:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390463.242392:0:13267:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95d6bc739000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390463.242397:0:13267:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff95d6bc2799b8) has exports, disconnecting them 00000020:00080000:3.0:1788390463.242402:0:13267:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95d6bc739000), last request at 1788390319 00000020:00000080:3.0:1788390463.242407:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31bf7 00000020:00080000:3.0:1788390463.242425:0:13267:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6bc739000): rc 0 00000020:00000080:3.0:1788390463.242430:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6bc739000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788390463.243318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc739000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788390463.244044:0:13267:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788390463.244050:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390463.244054:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788390463.244061:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390463.244388:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5810a6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788390463.244408:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788390463.247126:0:11621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788390463.249331:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788390463.249450:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95d6a6972a00:5790] 0 exiting: rc = 1 00000100:00100000:2.0:1788390463.249481:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff95d692260c00:5838] 2 exiting: rc = 0 00000100:00100000:2.0:1788390463.249617:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95d6a6973600:5791] 1 exiting: rc = 0 00000100:00100000:0.0:1788390463.249696:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390463.250387:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95d6a6973400:5792] 0 exiting: rc = 1 00000100:00100000:1.0:1788390463.250455:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95d6a6972200:5793] 1 exiting: rc = 0 00000100:00100000:2.0:1788390463.250535:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95d692223600:5794] 2 exiting: rc = 0 00000100:00100000:2.0:1788390463.250657:0:11126:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95d68f74aa00:11126] 3 exiting: rc = 0 00000100:00100000:0.0:1788390463.250742:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250752:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250759:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250768:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250774:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250779:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250785:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250792:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250798:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250804:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250810:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250816:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250821:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250828:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250842:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250847:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250853:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250858:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250878:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250884:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250889:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250894:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250899:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250903:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250908:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250913:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250917:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250922:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250928:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250933:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250938:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250944:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250949:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.250955:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251091:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251098:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251104:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251109:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251114:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251119:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251124:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251139:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251145:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251150:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251161:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251170:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251176:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251181:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251187:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251193:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251198:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251203:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251208:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251222:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251228:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251233:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251238:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251243:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251249:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251254:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251259:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251264:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251269:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.251274:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788390463.252101:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390463.252112:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788390463.252119:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d585010800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788390463.252124:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585010800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788390463.252144:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788390463.252200:0:13267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6a6b1a000 1 00000020:00000080:0.0:1788390463.252206:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd31b9c 00000020:00000080:0.0:1788390463.252213:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6a6b1d000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788390463.252232:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788390463.252238:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390463.252245:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390463.252249:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff95d68a663370) has no exports 00000020:00000080:2.0:1788390463.252252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b1d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788390463.263530:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390463.263549:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788390463.263555:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6a6b18000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788390463.263560:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b18000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788390463.263570:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788390463.263794:0:13267:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d6a6b19800 00000020:01000000:2.0:1788390463.263816:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788390463.263819:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390463.263822:0:13267:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788390463.263827:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff95d68a660000) has no exports 00000020:00000080:2.0:1788390463.263849:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390463.263853:0:13267:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788390463.263855:0:13267:0:(genops.c:885:class_export_put()) final put ffff95d6b640a800/OSS_uuid 00000020:00000080:2.0:1788390463.263857:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640a800/OSS_uuid for OSS 00000020:01000000:2.0:1788390463.263859:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788390463.263904:0:5802:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788390463.264142:0:6652:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff95d692217a00:6652] 1 exiting: rc = 0 00000100:00100000:1.0:1788390463.264228:0:6653:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff95d682f03c00:6653] 2 exiting: rc = 0 00000100:00100000:1.0:1788390463.264284:0:6650:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff95d68526e800:6650] 0 exiting: rc = 1 00000100:00100000:3.0:1788390463.264387:0:8777:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff95d69fc78c00:8777] 3 exiting: rc = 0 00000100:00100000:2.0:1788390463.264531:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264539:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264544:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264550:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264566:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264570:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264574:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264578:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264584:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264591:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264596:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264601:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264609:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264616:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264622:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264628:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264634:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264639:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264643:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264647:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264653:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264656:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264661:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264665:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264669:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264672:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264676:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264680:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264684:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264688:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264696:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264700:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264704:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264707:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264712:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264716:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264720:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264723:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264727:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264736:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264740:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264744:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264748:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264752:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264755:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264759:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264762:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264766:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264769:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264773:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264776:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264779:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264782:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264784:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264787:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264791:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264794:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264797:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264801:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264804:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264807:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264810:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264814:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.264817:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.266413:0:6654:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95d683499c00:6654] 0 exiting: rc = 1 00000100:00100000:2.0:1788390463.266743:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95d683498600:6655] 1 exiting: rc = 0 00000100:00100000:3.0:1788390463.267340:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267350:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267356:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267362:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267368:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267374:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267380:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267386:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267391:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267397:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267403:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267409:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267416:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267422:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267428:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267451:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267457:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267463:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267470:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267477:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267483:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267490:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267497:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267503:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267508:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267514:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267522:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267528:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267534:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267539:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267546:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267552:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267558:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267564:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267571:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267577:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267596:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267603:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267609:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267615:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267621:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267628:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267635:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267642:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267656:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267662:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267668:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267675:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267683:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267690:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267703:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267709:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267719:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267725:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267731:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267738:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267746:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267752:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267758:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267768:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267777:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267785:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267791:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390463.267798:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.270659:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95d692216c00:6658] 2 exiting: rc = 0 00000100:00100000:0.0:1788390463.271488:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95d692216400:6657] 1 exiting: rc = 0 00000100:00100000:3.0:1788390463.272163:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95d692216200:6656] 0 exiting: rc = 1 00000100:00100000:2.0:1788390463.272711:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272721:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272728:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272735:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272752:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272761:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272767:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272774:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272799:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272806:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272813:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272819:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272826:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272838:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272849:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272855:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272861:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272867:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272878:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272884:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.272891:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273109:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273118:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273125:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273141:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273149:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273155:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273162:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273168:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273175:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273181:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273187:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273194:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273200:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273206:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273213:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273219:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273239:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273246:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273253:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273259:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273266:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273272:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273285:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273292:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273299:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273305:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273312:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273319:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273325:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273332:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273338:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273345:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273352:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273358:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273365:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273371:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273377:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273384:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273391:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273398:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273405:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273411:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.273418:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.280794:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95d692216e00:6660] 1 exiting: rc = 0 00000100:00100000:1.0:1788390463.280846:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95d692216800:6659] 0 exiting: rc = 1 00000100:00100000:2.0:1788390463.281262:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281271:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281279:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281285:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281290:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281296:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281302:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281308:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281313:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281319:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281325:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281331:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281337:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281343:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281368:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281374:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281382:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281388:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281394:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281400:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281406:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281412:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281418:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281425:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281430:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281436:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281442:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281448:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281454:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281460:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281465:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281470:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281475:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281481:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281486:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281492:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281497:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281502:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281508:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281514:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281520:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281526:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281532:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281537:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281543:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281548:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281554:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281560:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281566:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281580:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281585:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281591:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281596:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281602:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281608:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281614:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281620:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281625:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281630:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281636:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281642:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281647:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281653:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.281660:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390463.282785:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95d683498400:6662] 1 exiting: rc = 0 00000100:00100000:1.0:1788390463.282934:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95d683498200:6661] 0 exiting: rc = 1 00000100:00100000:2.0:1788390463.283324:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283333:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283344:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283353:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283369:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283378:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283384:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283391:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283398:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283406:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283412:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283418:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283424:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283431:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283437:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283444:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283466:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283474:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283480:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283488:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283508:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283517:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283523:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283531:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283537:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283543:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283549:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283555:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283575:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283583:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283590:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283597:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283606:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283612:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283620:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283627:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283634:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283640:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283647:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283654:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283678:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283686:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283693:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283699:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283706:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283711:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283718:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283725:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283732:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283739:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283747:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283754:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283776:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283784:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283794:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283808:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283815:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283822:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283829:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283836:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283844:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283852:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283858:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390463.283862:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788390463.292869:0:13267:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788390474.718743:0:13877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788390479.927634:0:14336:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390479.927640:0:14336:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788390479.927750:0:14336:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d68527e000 00000020:01000004:1.0:1788390479.927768:0:14336:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788390479.927776:0:14336:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390479.927790:0:14336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95d68a6619b8) 00000020:00000080:1.0:1788390479.927860:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788390479.940704:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788390479.944799:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788390479.945249:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788390479.945388:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788390479.945565:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788390479.945638:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788390479.945772:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788390479.945948:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788390479.946239:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788390479.946488:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788390479.947575:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 68: rc = 0 00100000:10000000:0.0:1788390479.947675:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 68: rc = 0 00100000:10000000:0.0:1788390479.948324:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.948577:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:0.0:1788390479.948900:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1788390479.949310:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.949556:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:0.0:1788390479.949924:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.950339:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.950586:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1788390479.950924:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.951239:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1788390479.951502:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1788390479.951770:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390479.952373:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 95: rc = 0 00100000:10000000:0.0:1788390479.952617:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 95: rc = 0 00100000:10000000:0.0:1788390479.952955:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 95: rc = 0 00100000:10000000:0.0:1788390479.953275:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 95: rc = 0 00100000:10000000:0.0:1788390479.953533:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 95: rc = 0 00100000:10000000:0.0:1788390479.953780:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 95: rc = 0 00100000:10000000:0.0:1788390479.954284:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 95: rc = 0 00100000:10000000:0.0:1788390479.954540:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 95: rc = 0 00100000:10000000:0.0:1788390479.954810:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 95: rc = 0 00100000:10000000:0.0:1788390479.955167:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 95: rc = 0 00100000:10000000:0.0:1788390479.955395:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 95: rc = 0 00100000:10000000:0.0:1788390479.955630:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 95: rc = 0 00100000:10000000:0.0:1788390479.956056:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 95: rc = 0 00100000:10000000:0.0:1788390479.956319:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 95: rc = 0 00100000:10000000:0.0:1788390479.956571:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 95: rc = 0 00100000:10000000:0.0:1788390479.956800:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 95: rc = 0 00100000:10000000:0.0:1788390479.957243:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 95: rc = 0 00100000:10000000:0.0:1788390479.957494:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 95: rc = 0 00100000:10000000:0.0:1788390479.957725:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 95: rc = 0 00100000:10000000:0.0:1788390479.958218:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 95: rc = 0 00100000:10000000:0.0:1788390479.958541:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 95: rc = 0 00100000:10000000:0.0:1788390479.958789:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 95: rc = 0 00100000:10000000:0.0:1788390479.959081:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 95: rc = 0 00100000:10000000:0.0:1788390479.959317:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 95: rc = 0 00100000:10000000:0.0:1788390479.959571:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 95: rc = 0 00100000:10000000:0.0:1788390479.959835:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 95: rc = 0 00100000:10000000:0.0:1788390479.960286:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 95: rc = 0 00100000:10000000:0.0:1788390479.960543:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 95: rc = 0 00100000:10000000:0.0:1788390479.960819:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 95: rc = 0 00100000:10000000:0.0:1788390479.961212:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 95: rc = 0 00100000:10000000:0.0:1788390479.961463:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 95: rc = 0 00100000:10000000:0.0:1788390479.961729:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 95: rc = 0 00100000:10000000:0.0:1788390479.962281:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 84: rc = 0 00100000:10000000:0.0:1788390479.962750:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788390479.962917:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 69: rc = 0 00100000:10000000:0.0:1788390479.963206:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788390479.963272:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 69: rc = 0 00100000:10000000:0.0:1788390479.963445:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788390479.963510:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 69: rc = 0 00100000:10000000:0.0:1788390479.963860:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788390479.963931:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 73: rc = 0 00100000:10000000:0.0:1788390479.964251:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788390479.964308:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 73: rc = 0 00100000:10000000:0.0:1788390479.964483:0:14336:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788390479.964547:0:14336:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 73: rc = 0 00000020:00000080:0.0:1788390479.964774:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788390479.964782:0:14336:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390479.964795:0:14336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32cba 00000020:01000004:0.0:1788390479.964803:0:14336:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788390479.964808:0:14336:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788390479.964812:0:14336:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d68527e000 from MGS 00000020:01000004:0.0:1788390479.964816:0:14336:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788390479.964824:0:14336:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff95d6bc2799b8) 00000020:00000080:0.0:1788390479.964835:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788390479.964889:0:14336:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68527e000 from MGS, refs=2 00080000:01000000:0.0:1788390479.964894:0:14336:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788390479.964899:0:14336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32cc8 00000100:00100000:0.0:1788390479.965113:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788390479.965241:0:14336:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788390479.965247:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788390479.965707:0:14336:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788390479.965713:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788390479.966414:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390479.966571:0:14336:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788390479.966582:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788390479.967184:0:14336:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788390479.967191:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788390479.967502:0:14336:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788390479.967508:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788390479.968069:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390479.968072:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390479.968074:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390479.968346:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390479.968349:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390479.968350:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390479.968942:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788390479.976156:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788390479.977669:0:14336:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788390479.977686:0:14336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788390479.977689:0:14336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788390479.979165:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788390479.979297:0:14336:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788390479.979384:0:14336:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788390479.979854:0:14336:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788390479.982157:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390479.982373:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788390479.982381:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788390479.988552:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788390479.988562:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788390479.989171:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788390479.989179:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788390479.989940:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788390479.990082:0:14336:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:1.0:1788390479.990085:0:14336:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788390479.990115:0:14336:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:1.0:1788390479.990129:0:14336:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff95d68a660000) 00000020:00000080:1.0:1788390479.990146:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788390479.990225:0:14336:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d68527b800@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1788390479.990377:0:14336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:1.0:1788390479.990384:0:14336:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788390479.990888:0:14350:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788390479.991068:0:14351:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788390479.991141:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 6ebd9ca6-c84c-470c-bc70-726259965b52) 00000020:00000080:2.0:1788390479.991156:0:14336:0:(genops.c:1385:class_connect()) connect: client 6ebd9ca6-c84c-470c-bc70-726259965b52, cookie 0x9aafc5f04cd32cd6 00000100:00080000:2.0:1788390479.991166:0:14336:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390479.991172:0:14336:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d68527b800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390479.991204:0:14336:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc03df80 x1875263103249408/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390479.991224:0:14336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6ebd9ca6-c84c-470c-bc70-726259965b52->MGS 00000020:01000004:2.0:1788390479.991248:0:14336:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788390479.991253:0:14336:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788390479.991264:0:14336:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95d69180cd28) 00000020:00000080:2.0:1788390479.991273:0:14336:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788390479.991435:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ebd9ca6-c84c-470c-bc70-726259965b52:3285:1875263103249408:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788390479.991510:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390479.991622:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249408 00000100:00100000:1.0:1788390479.991629:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249408 00000100:00100000:1.0:1788390479.991663:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390479.991670:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1875263103249408:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788390479.991689:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6ebd9ca6-c84c-470c-bc70-726259965b52@0@lo t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1788390479.991707:0:14347:0:(genops.c:1385:class_connect()) connect: client 6ebd9ca6-c84c-470c-bc70-726259965b52, cookie 0x9aafc5f04cd32ce4 00000100:00080000:1.0:1788390479.991815:0:14347:0:(import.c:65:import_set_state_nolock()) ffff95d68527f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390479.991863:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+5:3285:x1875263103249408:12345-0@lo:250:mount.lustre.0 Request processed in 192us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390479.991871:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390479.991944:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788390479.991953:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:3.0:1788390479.991992:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788390479.991996:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788390479.992000:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d68527b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788390479.992002:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788390479.992011:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788390479.992016:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6ebd9ca6-c84c-470c-bc70-726259965b52:3285:1875263103249408:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788390480.005146:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390480.005309:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788390480.005313:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788390480.006351:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788390480.006357:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788390480.006656:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788390480.006661:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788390480.007514:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390480.007669:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788390480.007673:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788390480.008146:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788390480.008151:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788390480.032662:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390480.032853:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788390480.032860:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788390480.033592:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788390480.033599:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788390480.033928:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390480.034151:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788390480.034164:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788390480.034583:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788390480.034588:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788390480.034922:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390480.035133:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788390480.035136:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788390480.035497:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788390480.035503:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788390480.035813:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390480.036036:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788390480.036042:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788390480.036311:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788390480.036317:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788390480.053063:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390480.053291:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390480.053297:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788390480.056360:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390480.056373:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788390480.058256:0:14336:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390480.058270:0:14336:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788390480.059459:0:14336:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788390480.059482:0:14336:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788390480.059489:0:14336:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788390480.059644:0:14336:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788390480.059680:0:14336:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788390480.059685:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788390480.059687:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390480.059689:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390480.059690:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390480.059697:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390480.059698:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390480.059699:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390480.059701:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390480.059703:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390480.059704:0:14336:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390480.059706:0:14336:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788390480.059708:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390480.059709:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390480.059710:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390480.059711:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390480.059712:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390480.059713:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390480.059714:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390480.059715:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390480.059716:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390480.059717:0:14336:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390480.059763:0:14336:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788390480.059788:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390480.059880:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.059991:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.060261:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249536 00000100:00100000:2.0:1788390480.060270:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249536 00000100:00100000:2.0:1788390480.060345:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390480.060356:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+5:14336:x1875263103249536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390480.060401:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788390480.060404:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788390480.060407:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788390480.060669:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788390480.061017:0:14349:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788390480.062242:0:14371:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788390480.062248:0:14371:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788390480.062250:0:14371:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788390480.062284:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788390480.062532:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788390480.062541:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788390480.075664:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+5:14336:x1875263103249536:12345-0@lo:253:mount.lustre.0 Request processed in 15300us (15774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.075683:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390480.075772:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390480.075788:0:14336:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788390480.075791:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390480.075792:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390480.075793:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390480.075794:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390480.075796:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390480.075797:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390480.075799:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390480.075800:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390480.075802:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390480.075804:0:14336:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788390480.075821:0:14336:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d68527e000 from lustre-MDT0000 10000000:01000000:1.0:1788390480.075858:0:14336:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788390480.075860:0:14336:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788390480.075864:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d68a660000 10000000:01000000:1.0:1788390480.075880:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390480.075887:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d68a660000 from 1 10000000:01000000:1.0:1788390480.075890:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788390480.075927:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.075937:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.075948:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.076006:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390480.076047:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.076087:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.076088:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249664 00000100:00100000:3.0:1788390480.076096:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249664 00000100:00100000:3.0:1788390480.076139:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390480.076148:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+5:14336:x1875263103249664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390480.076160:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390480.076173:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd32cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32ceb expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.076195:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd32cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32ceb expref: 6 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.076219:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd32cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32ceb expref: 6 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.076229:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788390480.076268:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+6:14336:x1875263103249664:12345-0@lo:101:mount.lustre.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.076274:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390480.076441:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390480.076454:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.076464:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.076506:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390480.076531:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.076550:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.076592:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249792 00000100:00100000:3.0:1788390480.076597:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249792 00000100:00100000:3.0:1788390480.076629:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390480.076646:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+6:14336:x1875263103249792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390480.076862:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+6:14336:x1875263103249792:12345-0@lo:501:mount.lustre.0 Request processed in 225us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390480.076869:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390480.076918:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249792:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788390480.076944:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788390480.076991:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.077006:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390480.077014:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d68527e000 10000000:01000000:1.0:1788390480.077018:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390480.077021:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d68527e000 10000000:01000000:1.0:1788390480.077023:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788390480.077026:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d68527e000 from 1 10000000:01000000:1.0:1788390480.077028:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788390480.077045:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.077052:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.077059:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.077070:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390480.077097:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.077133:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.077208:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103249920 00000100:00100000:2.0:1788390480.077214:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103249920 00000100:00100000:2.0:1788390480.077283:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390480.077292:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+6:14336:x1875263103249920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390480.077299:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390480.077311:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd32d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32cf9 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.077325:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd32d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32cf9 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.077334:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd32d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32cf9 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.077348:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:2.0:1788390480.077383:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+7:14336:x1875263103249920:12345-0@lo:101:mount.lustre.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.077389:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390480.077425:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103249920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390480.077437:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d00 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.077445:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32d00 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390480.077456:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788390480.077472:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d00 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.077480:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63400/0x9aafc5f04cd32cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d00 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390480.077493:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788390480.077497:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390480.077501:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d68527e000 10000000:01000000:0.0:1788390480.077504:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788390480.077507:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788390480.077509:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788390480.077524:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.077530:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.077537:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390480.077550:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390480.077578:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390480.080974:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.082278:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250048 00000100:00100000:1.0:1788390480.082290:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250048 00000100:00100000:1.0:1788390480.082541:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390480.082558:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+7:14336:x1875263103250048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390480.082576:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390480.082600:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62600/0x9aafc5f04cd32d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32d07 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.082648:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62600/0x9aafc5f04cd32d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d07 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.082661:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62600/0x9aafc5f04cd32d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d07 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.082671:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390480.082748:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+8:14336:x1875263103250048:12345-0@lo:101:mount.lustre.0 Request processed in 195us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.082757:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390480.083041:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390480.083064:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d0e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.083076:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32d0e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.083151:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390480.083191:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.083287:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.083327:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250176 00000100:00100000:2.0:1788390480.083333:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250176 00000100:00100000:2.0:1788390480.083397:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390480.083419:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+8:14336:x1875263103250176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390480.084022:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14336:x1875263103250176:12345-0@lo:501:mount.lustre.0 Request processed in 616us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.084032:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390480.086083:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390480.086142:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390480.086210:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.086245:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250304 00000100:00100000:1.0:1788390480.086251:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250304 00000100:00100000:1.0:1788390480.086292:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390480.086300:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14336:x1875263103250304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390480.087534:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.087769:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14336:x1875263103250304:12345-0@lo:503:mount.lustre.0 Request processed in 1466us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.087779:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390480.087804:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390480.088770:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14372:1875263103250432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390480.088820:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390480.088895:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc7116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.089126:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250432 00000100:00100000:1.0:1788390480.089133:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250432 00000100:00100000:0.0:1788390480.089242:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390480.089252:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14372:x1875263103250432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390480.089820:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14372:x1875263103250432:12345-0@lo:502:llog_process_th.0 Request processed in 568us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390480.089833:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390480.090127:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14372:1875263103250432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390480.090157:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.090169:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.090172:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788390480.090178:0:14372:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788390480.090181:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390480.090198:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95d68a663370) 00000020:00000080:1.0:1788390480.090217:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788390480.090223:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788390480.094084:0:14372:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788390480.094104:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32d1c 00000020:00000080:0.0:1788390480.094357:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788390480.094368:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390480.094374:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390480.094376:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788390480.094379:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390480.094385:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390480.094386:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788390480.094390:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390480.094402:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95d6bc278000) 00000020:00000080:0.0:1788390480.094416:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788390480.094420:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788390480.094422:0:14372:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788390480.094425:0:14372:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788390480.094432:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788390480.094482:0:14372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68527e000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788390480.094494:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95d6bc27b370) 00000020:00000080:0.0:1788390480.094502:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788390480.094581:0:14372:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788390480.094586:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd32d31 00000020:00000080:0.0:1788390480.095755:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788390480.095765:0:14372:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788390480.095772:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aafc5f04cd32d38 00080000:01000000:0.0:1788390480.095778:0:14372:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788390480.095782:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32d3f 00010000:00010000:2.0:1788390480.194578:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788390480.198431:0:14372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967524 00000001:00080000:2.0:1788390480.198641:0:14372:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788390480.199376:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95d6918099b8) 00000020:00000080:2.0:1788390480.199397:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788390480.199466:0:14372:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788390480.199474:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32d4d 00000020:00000080:0.0:1788390480.200052:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788390480.205499:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aafc5f04cd32d54 00000020:00000080:2.0:1788390480.209432:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788390480.209444:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390480.209450:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.209452:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788390480.209454:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390480.209459:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.209460:0:14372:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788390480.209463:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788390480.209494:0:14372:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788390480.209504:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390480.209512:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.209513:0:14372:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788390480.209515:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788390480.209516:0:14372:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788390480.209517:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390480.209518:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390480.209519:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788390480.209520:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.209521:0:14372:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788390480.209523:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788390480.209525:0:14372:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788390480.209527:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.209528:0:14372:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788390480.209529:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788390480.209533:0:14372:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1788390480.209553:0:14372:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788390480.209555:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390480.209568:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95d69180b370) 00000020:00000080:2.0:1788390480.209645:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788390480.209652:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788390480.209691:0:14372:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788390480.209694:0:14372:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788390480.209699:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32d62 00010000:00080000:2.0:1788390480.209724:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d686d55000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788390480.209920:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788390480.210279:0:14372:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788390480.210307:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788390480.211122:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390480.211160:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788390480.211206:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788390480.211538:0:14376:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390480.211542:0:14376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788390480.212382:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788390480.212392:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788390480.212424:0:14372:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788390480.212442:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd32d69 00000100:00080000:2.0:1788390480.212453:0:14372:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390480.212458:0:14372:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d686d55000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390480.212492:0:14372:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc03d880 x1875263103250560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390480.212525:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788390480.212575:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390480.212579:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.212591:0:14372:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788390480.212595:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788390480.212597:0:14372:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788390480.212598:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390480.212599:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390480.212601:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788390480.212603:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.212605:0:14372:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788390480.212607:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788390480.212611:0:14372:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788390480.212614:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390480.212615:0:14372:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788390480.212618:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788390480.212621:0:14372:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1788390480.212642:0:14372:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788390480.212645:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390480.212657:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95d691808000) 00000020:00000080:2.0:1788390480.212668:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788390480.212672:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788390480.212724:0:14372:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788390480.212731:0:14372:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788390480.212737:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd32d77 00010000:00080000:2.0:1788390480.212817:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6a0fa9000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788390480.213066:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788390480.213238:0:14372:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788390480.213259:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788390480.213842:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390480.213900:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788390480.214022:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788390480.214173:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103250560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788390480.214230:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103250560 offset 0 length 520: 4 00000040:00080000:2.0:1788390480.214820:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390480.214825:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788390480.218743:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390480.218760:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788390480.218801:0:14372:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788390480.218820:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd32d7e 00000100:00080000:1.0:1788390480.218830:0:14372:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390480.218836:0:14372:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6a0fa9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390480.218873:0:14372:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e5c00 x1875263103250688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390480.218939:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103250688:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788390480.219060:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103250688 offset 0 length 520: 4 00000100:00080000:1.0:1788390480.219170:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788390480.219277:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390480.219282:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.219285:0:14372:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788390480.219288:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.219292:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.219293:0:14372:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390480.219297:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390480.219299:0:14372:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788390480.219301:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390480.219304:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.219305:0:14372:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788390480.219308:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.219310:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.219312:0:14372:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788390480.219315:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788390480.219344:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14372:1875263103250816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390480.219393:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.219410:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.221148:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250816 00000100:00100000:3.0:1788390480.221158:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250816 00000100:00100000:3.0:1788390480.221204:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390480.221214:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14372:x1875263103250816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390480.221429:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14372:x1875263103250816:12345-0@lo:502:llog_process_th.0 Request processed in 216us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.221437:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390480.221466:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14372:1875263103250816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390480.221495:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390480.221500:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.221502:0:14372:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390480.221507:0:14372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788390480.221665:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788390480.221686:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788390480.221708:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d0e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.221719:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b64fba00/0x9aafc5f04cd32d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d0e expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390480.221728:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68527e000 from 1 10000000:01000000:0.0:1788390480.221731:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788390480.221759:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.221767:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.221776:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390480.221794:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390480.221827:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390480.221862:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.222016:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103250944 00000100:00100000:3.0:1788390480.222021:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103250944 00000100:00100000:3.0:1788390480.222050:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390480.222057:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+9:14336:x1875263103250944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390480.222068:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390480.222082:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32d85 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.222103:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.222110:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.222125:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0e00, rc 0) 00000100:00100000:3.0:1788390480.222154:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+10:14336:x1875263103250944:12345-0@lo:101:mount.lustre.0 Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.222160:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390480.222176:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103250944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390480.222187:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390480.222196:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390480.222752:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251072:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788390480.222790:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390480.222885:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.222925:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251072 00000100:00100000:3.0:1788390480.222930:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251072 00000100:00100000:2.0:1788390480.223162:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390480.223172:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+10:14336:x1875263103251072:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788390480.223201:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788390480.223207:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788390480.223364:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+10:14336:x1875263103251072:12345-0@lo:256:mount.lustre.0 Request processed in 194us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.223371:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390480.223438:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251072:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788390480.224037:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788390480.224058:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.224068:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390480.224088:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68527e000 from 1 10000000:01000000:1.0:1788390480.224091:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390480.224116:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.224124:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.224134:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.224147:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390480.224171:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.224263:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.224432:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251200 00000100:00100000:2.0:1788390480.224437:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251200 00000100:00100000:2.0:1788390480.224465:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390480.224470:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+10:14336:x1875263103251200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390480.224478:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390480.224488:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32d93 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.224501:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.224508:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.224521:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:2.0:1788390480.224544:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251200:12345-0@lo:101:mount.lustre.0 Request processed in 74us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.224549:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390480.224608:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390480.224617:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390480.224623:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390480.224655:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390480.224671:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.224686:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.224795:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251328 00000100:00100000:2.0:1788390480.224799:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251328 00000100:00100000:2.0:1788390480.224828:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390480.224835:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390480.225256:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251328:12345-0@lo:501:mount.lustre.0 Request processed in 420us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.225263:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390480.225351:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390480.225382:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390480.225421:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390480.225452:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6833890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.225533:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251456 00000100:00100000:1.0:1788390480.225538:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251456 00000100:00100000:1.0:1788390480.225558:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390480.225571:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390480.225853:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251456:12345-0@lo:503:mount.lustre.0 Request processed in 282us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.225860:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390480.226154:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390480.227011:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14380:1875263103251584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390480.227055:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.227084:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390480.227152:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251584 00000100:00100000:0.0:1788390480.227157:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251584 00000100:00100000:0.0:1788390480.227184:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390480.227192:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14380:x1875263103251584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390480.227398:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14380:x1875263103251584:12345-0@lo:502:llog_process_th.0 Request processed in 206us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390480.227405:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390480.227474:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14380:1875263103251584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390480.227499:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.227508:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.227510:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390480.227518:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d68527e000 00000020:00000080:1.0:1788390480.227520:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390480.227527:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390480.227529:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.227530:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390480.227533:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.227535:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.227536:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390480.227539:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d68527e000 00000020:00000080:1.0:1788390480.227541:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390480.227599:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390480.227603:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.227604:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390480.227607:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390480.227610:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390480.227611:0:14380:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390480.227615:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d68527e000 00000020:00000080:1.0:1788390480.227617:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390480.227657:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14380:1875263103251712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390480.227688:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.227722:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.228771:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251712 00000100:00100000:3.0:1788390480.228778:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251712 00000100:00100000:3.0:1788390480.228816:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390480.228824:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14380:x1875263103251712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390480.229026:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14380:x1875263103251712:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.229033:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390480.229079:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14380:1875263103251712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390480.229110:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390480.229116:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390480.229117:0:14380:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788390480.229122:0:14380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788390480.234448:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788390480.234484:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390480.234510:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.234524:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390480.234571:0:14336:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788390480.234575:0:14336:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d68527e000 10000000:01000000:2.0:1788390480.234578:0:14336:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d68527e000 10000000:01000000:2.0:1788390480.234582:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390480.234587:0:14336:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d68527e000 from 1 10000000:01000000:2.0:1788390480.234590:0:14336:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390480.234625:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.234646:0:14336:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.234657:0:14336:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390480.234682:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390480.234748:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390480.234784:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.234803:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251840 00000100:00100000:2.0:1788390480.234809:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251840 00000100:00100000:2.0:1788390480.234886:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390480.234896:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103251840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390480.234908:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390480.234921:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd32da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32da1 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.234942:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd32da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32da1 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.234952:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd32da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32da1 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.235000:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:2.0:1788390480.235035:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103251840:12345-0@lo:101:mount.lustre.0 Request processed in 141us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.235042:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390480.236058:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390480.236085:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32da8 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390480.236096:0:14336:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32da8 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390480.236149:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390480.236187:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390480.239137:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6833896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.246996:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103251968 00000100:00100000:1.0:1788390480.247013:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103251968 00000100:00100000:1.0:1788390480.247068:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390480.247077:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103251968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390480.247344:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103251968:12345-0@lo:501:mount.lustre.0 Request processed in 267us (11155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.247351:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390480.249745:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103251968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390480.249799:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103252096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390480.249861:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390480.249936:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6833896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390480.253381:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252096 00000100:00100000:1.0:1788390480.253395:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252096 00000100:00100000:1.0:1788390480.253448:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390480.253460:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103252096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390480.253746:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103252096:12345-0@lo:503:mount.lustre.0 Request processed in 288us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.253754:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390480.253898:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103252096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390480.256532:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14386:1875263103252224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390480.256613:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.256696:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.256790:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252224 00000100:00100000:2.0:1788390480.256797:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252224 00000100:00100000:2.0:1788390480.256876:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390480.256887:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14386:x1875263103252224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390480.257173:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14386:x1875263103252224:12345-0@lo:502:llog_process_th.0 Request processed in 287us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.257182:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390480.257279:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14386:1875263103252224:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788390480.257336:0:14386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788390480.257350:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95d6bc27cd28) 00000020:00000080:0.0:1788390480.257369:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788390480.257439:0:14386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68527e000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788390480.257443:0:14386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d68527e000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788390480.257446:0:14386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d68527e000 4 00010000:00080000:0.0:1788390480.257476:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d686d4b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788390480.259175:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788390480.259369:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788390480.259399:0:14386:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788390480.259414:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aafc5f04cd32db6 00000100:00080000:0.0:1788390480.259423:0:14386:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390480.259429:0:14386:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d686d4b000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390480.259462:0:14386:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf2a00 x1875263103252352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390480.259512:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103252352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390480.259600:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390480.259671:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252352 00000100:00100000:0.0:1788390480.259677:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252352 00000100:00100000:0.0:1788390480.259704:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390480.259712:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103252352:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390480.259768:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103252352:12345-0@lo:38:llog_process_th.0 Request processed in 55us (179us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788390480.259775:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390480.259807:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390480.259814:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d686d4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390480.259829:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788390480.259832:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103252352:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788390480.259860:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390480.260051:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14386:1875263103252480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390480.260091:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390480.265071:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252480 00000100:00100000:1.0:1788390480.265086:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252480 00000100:00100000:1.0:1788390480.265134:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390480.265144:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14386:x1875263103252480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390480.265423:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14386:x1875263103252480:12345-0@lo:502:llog_process_th.0 Request processed in 280us (5329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390480.265439:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390480.266367:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390480.266394:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6ebd9ca6-c84c-470c-bc70-726259965b52:14386:1875263103252480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788390480.266430:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788390480.266639:0:14336:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788390480.266656:0:14336:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390480.266677:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32da8 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.266687:0:14336:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92800/0x9aafc5f04cd32da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32da8 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788390480.266732:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788390480.266734:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390480.266735:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390480.266736:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390480.266737:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390480.266738:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390480.266740:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390480.266742:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390480.266743:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390480.266744:0:14336:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788390480.266748:0:14336:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788390480.266750:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390480.266751:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390480.266782:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390480.266783:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390480.266784:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390480.266791:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390480.266792:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390480.266793:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390480.266794:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390480.266795:0:14336:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788390480.266814:0:14336:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788390480.266830:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103252608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788390480.266882:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390480.266907:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.266925:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252608 00000100:00100000:2.0:1788390480.266930:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252608 00000100:00100000:2.0:1788390480.266957:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390480.267022:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14336:x1875263103252608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390480.267056:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390480.267069:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788390480.288803:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788390480.288819:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788390480.288880:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390480.288885:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390480.288908:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.288926:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.288935:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289011:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289024:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 12 pid: 14348 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390480.289038:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103252736:0@lo:104: 00000100:00100000:2.0:1788390480.289111:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390480.289147:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683389300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390480.289183:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252736 00000100:00100000:2.0:1788390480.289190:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252736 00000100:00100000:2.0:1788390480.289230:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390480.289238:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103252736:12345-0@lo:104: 00010000:00010000:2.0:1788390480.289250:0:14337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289293:0:14337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390480.289299:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103252736:12345-0@lo:104: Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.289306:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788390480.289327:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390480.289332:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289339:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390480.289343:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289352:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390480.289360:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390480.289366:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390480.289396:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289412:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390480.289450:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289458:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b64fa200/0x9aafc5f04cd32d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d8c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289473:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390480.289475:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390480.289476:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390480.289497:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103252864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390480.289530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390480.289576:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252864 00000100:00100000:2.0:1788390480.289580:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252864 00010000:00010000:2.0:1788390480.289595:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 13 pid: 14348 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390480.289614:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390480.289620:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+13:3288:x1875263103252864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390480.289630:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390480.289634:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 13 pid: 14348 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289644:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 13 pid: 14348 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289659:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289676:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390480.289688:0:14339:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000803611s 00010000:00010000:2.0:1788390480.289692:0:14339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289699:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289707:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289713:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289719:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390480.289722:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289730:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289738:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289747:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390480.289776:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+13:3288:x1875263103252864:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390480.289782:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390480.289822:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103252864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390480.289847:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32d85 expref: 12 pid: 14348 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390480.289860:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103252736:0@lo:104: 00010000:00010000:2.0:1788390480.289870:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289878:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289884:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390480.289890:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd32dbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390480.299243:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14336:x1875263103252608:12345-0@lo:253:mount.lustre.0 Request processed in 32230us (32352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390480.299295:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390480.299419:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:14336:1875263103252608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788390480.299433:0:14336:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788390480.299437:0:14336:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390480.299438:0:14336:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390480.299440:0:14336:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390480.299441:0:14336:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390480.299443:0:14336:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390480.299444:0:14336:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390480.299446:0:14336:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390480.299447:0:14336:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390480.299449:0:14336:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390480.299451:0:14336:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788390480.299463:0:14336:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390480.305565:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.305719:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390480.306150:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.306290:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390480.306519:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.306661:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390480.307460:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.307619:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390480.307943:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.308276:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390480.308542:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390480.308703:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788390480.328732:0:14336:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788390480.329153:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788390480.329167:0:14394:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788390480.329171:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788390480.329326:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788390480.329401:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788390480.330586:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788390480.330665:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390480.332772:0:14395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788390480.332839:0:14395:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788390480.332843:0:14395:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1788390480.333178:0:14336:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788390480.333194:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788390480.333436:0:14336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390480.334599:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788390480.335318:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788390480.335354:0:14336:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788390480.335779:0:14336:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788390480.337010:0:14336:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788390480.341493:0:14336:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788390480.364447:0:14336:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788390480.364483:0:14336:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8581cdf988 00100000:10000000:1.0:1788390480.364491:0:14336:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788390480.365526:0:14336:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788390480.365540:0:14336:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788390480.365555:0:14336:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788390480.365572:0:14336:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788390480.976097:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390481.293138:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390481.293145:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390481.293462:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788390481.293467:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1788390481.678061:0:14351:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390481.678068:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68527e000 from 6 10000000:01000000:1.0:1788390481.678072:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390481.678112:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390481.678120:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390481.678129:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390481.678162:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103252992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390481.678248:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390481.678307:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390481.679077:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103252992 00000100:00100000:2.0:1788390481.679091:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103252992 00000100:00100000:2.0:1788390481.679194:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390481.679207:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14351:x1875263103252992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390481.679222:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390481.679238:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32dc4 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390481.679265:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390481.679276:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390481.679286:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:2.0:1788390481.679348:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103252992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390481.679356:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390481.679444:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103252992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390481.679459:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390481.679469:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390481.679521:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788390481.679553:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390481.679641:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390481.679683:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253120 00000100:00100000:0.0:1788390481.679688:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253120 00000100:00100000:0.0:1788390481.679709:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390481.679716:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390481.679729:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390481.679745:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390481.679748:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788390481.679821:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390481.679835:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390481.679868:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788390481.679921:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788390481.679929:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390481.679937:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390482.000242:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390482.317233:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390482.317242:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390482.317273:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788390482.317279:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788390483.021125:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390483.203299:0:14640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788390484.046820:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390485.074910:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390485.334211:0:14790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc10576d80 20000000:00000080:0.0:1788390485.334239:0:14790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d6912a0400 uarg=0000000000000000 20000000:01000000:0.0:1788390485.334361:0:14790:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788390485.334372:0:14790:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788390485.334379:0:14790:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788390485.343407:0:14791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788390485.343565:0:14790:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788390485.347746:0:14790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390485.347791:0:14790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.347817:0:14790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.347849:0:14790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.347905:0:14790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.347923:0:14790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390485.353894:0:14790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14790:1875263103253248:0@lo:104: 00000100:00100000:2.0:1788390485.354475:0:14790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390485.354549:0:14790:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390485.354624:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253248 00000100:00100000:0.0:1788390485.354637:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253248 00000100:00100000:0.0:1788390485.354708:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390485.354720:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14790:x1875263103253248:12345-0@lo:104: 00010000:00010000:0.0:1788390485.354743:0:14337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390485.354821:0:14337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390485.354828:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14790:x1875263103253248:12345-0@lo:104: Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390485.354851:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788390485.354908:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390485.354918:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390485.354926:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390485.354942:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390485.354953:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390485.354985:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390485.355003:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390485.355053:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390485.355060:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390485.355091:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390485.355109:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62800/0x9aafc5f04cd32d93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32d9a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390485.355140:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390485.355142:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390485.355143:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390485.355157:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103253376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390485.355191:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390485.355408:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253376 00000100:00100000:2.0:1788390485.355413:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253376 00010000:00010000:2.0:1788390485.355436:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 12 pid: 14349 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390485.355471:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390485.355479:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:3289:x1875263103253376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390485.355490:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390485.355496:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 12 pid: 14349 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355516:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 12 pid: 14349 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355538:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355547:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355564:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355571:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355579:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355586:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355592:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390485.355596:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355603:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355611:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390485.355631:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390485.355670:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:3289:x1875263103253376:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390485.355677:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390485.355758:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103253376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390485.355873:0:14790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd32d9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32d93 expref: 11 pid: 14349 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390485.355885:0:14790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14790:1875263103253248:0@lo:104: 00010000:00010000:3.0:1788390485.355903:0:14790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.355911:0:14790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.355918:0:14790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390485.355925:0:14790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32dd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788390485.453168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390485.453182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390485.453185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390485.453188:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390485.453191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788390485.453195:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788390485.453200:0:36:0:(import.c:65:import_set_state_nolock()) ffff95d686d4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390485.453221:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d686d4b000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390485.453284:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e5500 x1875263103253504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390485.453372:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103253504:0@lo:38:kworker.0 00000100:00100000:2.0:1788390485.453469:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390485.453589:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253504 00000100:00100000:1.0:1788390485.453600:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253504 00000100:00100000:1.0:1788390485.453647:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390485.453658:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103253504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788390485.453689:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:1.0:1788390485.453740:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aafc5f04cd32dd9 00000004:00100000:1.0:1788390485.453760:0:14356:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390485.453950:0:14356:0:(import.c:65:import_set_state_nolock()) ffff95d585012000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390485.454056:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103253504:12345-0@lo:38:kworker.0 Request processed in 396us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390485.454065:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390485.455393:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d68a7e5500 x1875263103253504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390485.455421:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788390485.455434:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788390485.455440:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788390485.455445:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d686d4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390485.455453:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103253504:0@lo:38:kworker.0 00010000:00010000:2.0:1788390486.093368:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390486.798069:0:14351:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390486.798080:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68527e000 from 10 10000000:01000000:0.0:1788390486.798086:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390486.798170:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390486.798182:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390486.798194:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390486.798223:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390486.798294:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390486.798364:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390486.798430:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253632 00000100:00100000:1.0:1788390486.798438:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253632 00000100:00100000:1.0:1788390486.798493:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390486.798504:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+11:14351:x1875263103253632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390486.798519:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390486.798532:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32de0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390486.798554:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390486.798564:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390486.798574:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62a00, rc 0) 00000100:00100000:1.0:1788390486.798629:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390486.798636:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390486.798784:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390486.798799:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390486.798808:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390486.798872:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390486.798898:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390486.798933:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390486.799037:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253760 00000100:00100000:1.0:1788390486.799042:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253760 00000100:00100000:1.0:1788390486.799070:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390486.799078:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390486.799312:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390486.799320:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390486.799407:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390486.799443:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390486.799478:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390486.799495:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390486.799580:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103253888 00000100:00100000:1.0:1788390486.799585:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103253888 00000100:00100000:1.0:1788390486.799609:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390486.799615:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390486.799753:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:14351:x1875263103253888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390486.799760:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390486.799949:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103253888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390486.801233:0:14896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788390486.801417:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788390486.801445:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390486.801457:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390486.801469:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390487.120610:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390488.145457:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390488.437697:0:15039:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390488.437701:0:15039:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788390488.437820:0:15039:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d69ef6c800 00000020:01000004:1.0:1788390488.437837:0:15039:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788390488.437850:0:15039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390488.437863:0:15039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d68a664d28) 00000020:00000080:1.0:1788390488.437879:0:15039:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788390488.453160:0:15039:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788390488.453423:0:15039:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788390488.454192:0:15039:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390488.454427:0:15039:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788390488.454635:0:15039:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788390488.455359:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 657: rc = 0 00100000:10000000:0.0:1788390488.455455:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 657: rc = 0 00100000:10000000:0.0:1788390488.455591:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 657: rc = 0 00100000:10000000:0.0:1788390488.456264:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 571: rc = 0 00100000:10000000:0.0:1788390488.456501:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 571: rc = 0 00100000:10000000:0.0:1788390488.456736:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 571: rc = 0 00100000:10000000:0.0:1788390488.457175:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 571: rc = 0 00100000:10000000:0.0:1788390488.457588:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 571: rc = 0 00100000:10000000:0.0:1788390488.457916:0:15039:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 571: rc = 0 00000020:00000080:0.0:1788390488.458551:0:15039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788390488.458563:0:15039:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390488.458573:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd32df5 00000020:01000004:0.0:1788390488.458583:0:15039:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788390488.458604:0:15039:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788390488.458608:0:15039:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788390488.458614:0:15039:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788390488.458618:0:15039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788390488.458638:0:15039:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d6913199b8) 00000020:00000080:0.0:1788390488.458650:0:15039:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788390488.459737:0:15039:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390488.459894:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390488.459918:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788390488.464895:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788390488.464917:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788390488.466135:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788390488.466144:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788390488.467325:0:15039:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390488.467516:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788390488.467522:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788390488.470488:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788390488.470503:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788390488.498815:0:15039:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390488.499117:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788390488.499124:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788390488.500337:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788390488.500346:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788390488.500936:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788390488.500943:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788390488.502576:0:15039:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390488.502762:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788390488.502769:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788390488.503385:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390488.503393:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788390488.539813:0:15039:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390488.540073:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788390488.540080:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788390488.541534:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390488.541544:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788390488.541914:0:15039:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788390488.541941:0:15039:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788390488.541948:0:15039:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788390488.550446:0:15039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390488.550485:0:15039:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788390488.550489:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390488.550491:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390488.550492:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390488.550494:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390488.550495:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390488.550496:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390488.550497:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390488.550499:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390488.550500:0:15039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390488.550503:0:15039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788390488.550505:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390488.550507:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390488.550508:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390488.550509:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390488.550510:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390488.550511:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390488.550512:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390488.550513:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390488.550514:0:15039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390488.550544:0:15039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788390488.550565:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390488.550645:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.550773:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.550886:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254016 00000100:00100000:1.0:1788390488.550895:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254016 00000100:00100000:1.0:1788390488.551104:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390488.551115:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:15039:x1875263103254016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390488.551162:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788390488.551166:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788390488.551170:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788390488.557217:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+12:15039:x1875263103254016:12345-0@lo:253:mount.lustre.0 Request processed in 6092us (6560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.557236:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390488.557353:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390488.557369:0:15039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788390488.557372:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390488.557375:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390488.557390:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390488.557391:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390488.557393:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390488.557394:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390488.557396:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390488.557398:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390488.557399:0:15039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390488.557421:0:15039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d69ef6c800 from lustre-OST0000 10000000:01000000:0.0:1788390488.557448:0:15039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788390488.557451:0:15039:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788390488.557459:0:15039:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d68a660000 local copy 00010000:00010000:0.0:1788390488.557469:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390488.557695:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390488.557732:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.557772:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.557851:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254144 00000100:00100000:1.0:1788390488.557859:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254144 00000100:00100000:1.0:1788390488.557922:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390488.557932:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:15039:x1875263103254144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390488.558131:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+12:15039:x1875263103254144:12345-0@lo:501:mount.lustre.0 Request processed in 200us (397us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390488.558139:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390488.558292:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254144:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788390488.558305:0:15039:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788390488.558441:0:15039:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788390488.558449:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.558460:0:15039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390488.558484:0:15039:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d69ef6c800 10000000:01000000:0.0:1788390488.558488:0:15039:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788390488.558493:0:15039:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d68a660000 10000000:01000000:0.0:1788390488.558495:0:15039:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788390488.558499:0:15039:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d68a660000 from 1 10000000:01000000:0.0:1788390488.558507:0:15039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788390488.558534:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.558542:0:15039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.558552:0:15039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390488.558565:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390488.558593:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.558623:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390488.558691:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254272 00000100:00100000:3.0:1788390488.558696:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254272 00000100:00100000:3.0:1788390488.558734:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390488.558742:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+12:15039:x1875263103254272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390488.558751:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390488.558764:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32e0a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32e03 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.558785:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32e0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e03 expref: 13 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.558794:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1200/0x9aafc5f04cd32e0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e03 expref: 13 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.558815:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1200, rc 0) 00000100:00100000:3.0:1788390488.558847:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+13:15039:x1875263103254272:12345-0@lo:101:mount.lustre.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390488.558853:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390488.558994:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390488.559006:0:15039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e0a expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.559015:0:15039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32e0a expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390488.559029:0:15039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788390488.559046:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e0a expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.559054:0:15039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b64fac00/0x9aafc5f04cd32e03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e0a expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390488.559060:0:15039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788390488.559064:0:15039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390488.559074:0:15039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788390488.559076:0:15039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788390488.559091:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.559099:0:15039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.559106:0:15039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390488.559119:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390488.559145:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.559162:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68375a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.559219:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254400 00000100:00100000:1.0:1788390488.559224:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254400 00000100:00100000:1.0:1788390488.559255:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390488.559262:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+13:15039:x1875263103254400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390488.559269:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390488.559278:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd32e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32e11 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.559291:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd32e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e11 expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.559308:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd32e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e11 expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.559313:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390488.559340:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254400:12345-0@lo:101:mount.lustre.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.559347:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390488.559421:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390488.559431:0:15039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e18 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.559438:0:15039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32e18 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390488.560168:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788390488.562547:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390488.562848:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788390488.562897:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788390488.562940:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788390488.563011:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788390488.563043:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788390488.563068:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788390488.563118:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788390488.563125:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788390488.563231:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390488.563301:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390488.563349:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684531c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390488.563540:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254528 00000100:00100000:3.0:1788390488.563547:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254528 00000100:00100000:3.0:1788390488.563600:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390488.563610:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390488.564028:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254528:12345-0@lo:501:mount.lustre.0 Request processed in 419us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390488.564037:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390488.564230:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390488.564268:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390488.564309:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390488.564328:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684531c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390488.564377:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254656 00000100:00100000:3.0:1788390488.564383:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254656 00000100:00100000:3.0:1788390488.564412:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390488.564418:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390488.564734:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254656:12345-0@lo:503:mount.lustre.0 Request processed in 315us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390488.564742:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390488.565038:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788390488.565715:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390488.565879:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390488.565941:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390488.566070:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684531240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390488.566119:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254784 00000100:00100000:0.0:1788390488.566125:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254784 00000100:00100000:0.0:1788390488.566213:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390488.566223:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390488.566436:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254784:12345-0@lo:502:mount.lustre.0 Request processed in 214us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.566449:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390488.566527:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390488.566753:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788390488.566794:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788390488.566841:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788390488.566885:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788390488.566934:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788390488.566992:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788390488.567041:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788390488.567090:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788390488.567127:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788390488.567187:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788390488.567226:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788390488.567286:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788390488.567319:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390488.567362:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390488.567649:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684531240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390488.567750:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103254912 00000100:00100000:3.0:1788390488.567756:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103254912 00000100:00100000:3.0:1788390488.567791:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390488.567809:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390488.568003:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103254912:12345-0@lo:502:mount.lustre.0 Request processed in 204us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390488.568011:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390488.568141:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103254912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390488.568208:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788390488.568218:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788390488.569145:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788390488.569154:0:15053:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788390488.569161:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.569163:0:15053:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788390488.569171:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390488.569186:0:15053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d691318000) 00000020:00000080:0.0:1788390488.569207:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788390488.569213:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788390488.569291:0:15053:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d69ef6c800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788390488.569299:0:15053:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788390488.569306:0:15053:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd32e26 00010000:00010000:0.0:1788390488.575393:0:15053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788390488.575946:0:15053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788390488.577991:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788390488.579347:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788390488.579361:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390488.579367:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579369:0:15053:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788390488.579374:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788390488.579377:0:15053:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788390488.579379:0:15053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788390488.579380:0:15053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788390488.579381:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788390488.579384:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579385:0:15053:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788390488.579388:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390488.579391:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579393:0:15053:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390488.579395:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390488.579397:0:15053:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390488.579400:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390488.579410:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579411:0:15053:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788390488.579415:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390488.579418:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579419:0:15053:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788390488.579422:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788390488.579483:0:15053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390488.579486:0:15053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390488.579487:0:15053:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788390488.579491:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788390488.587140:0:15039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788390488.587195:0:15039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788390488.587225:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e18 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390488.587239:0:15039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b64fb000/0x9aafc5f04cd32e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e18 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390488.587416:0:15039:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69ef6c800 from 1 10000000:01000000:2.0:1788390488.587419:0:15039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390488.587460:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390488.587468:0:15039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390488.587479:0:15039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390488.587501:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390488.587570:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.587658:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255040 00000100:00100000:0.0:1788390488.587666:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255040 00000100:00100000:2.0:1788390488.588208:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a7056000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390488.589936:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390488.589952:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+14:15039:x1875263103255040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390488.589988:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390488.590007:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32e2d expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.590035:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.590046:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.590055:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:0.0:1788390488.590233:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255040:12345-0@lo:101:mount.lustre.0 Request processed in 285us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.590240:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390488.590661:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390488.590680:0:15039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.590690:0:15039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390488.594370:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788390488.594700:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390488.595185:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788390488.595224:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788390488.595273:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788390488.595279:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788390488.595347:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390488.595409:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.595489:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.595539:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255168 00000100:00100000:1.0:1788390488.595546:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255168 00000100:00100000:1.0:1788390488.595622:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390488.595632:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390488.595892:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255168:12345-0@lo:501:mount.lustre.0 Request processed in 261us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.595911:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390488.596011:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390488.596041:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390488.596079:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.596366:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390488.596441:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255296 00000100:00100000:2.0:1788390488.596445:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255296 00000100:00100000:2.0:1788390488.596468:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788390488.596476:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390488.596617:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255296:12345-0@lo:503:mount.lustre.0 Request processed in 142us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390488.596624:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390488.596700:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390488.597105:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390488.597154:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390488.597195:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.597213:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390488.597341:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255424 00000100:00100000:2.0:1788390488.597346:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255424 00000100:00100000:2.0:1788390488.597367:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390488.597372:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390488.597490:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255424:12345-0@lo:502:mount.lustre.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390488.597498:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390488.597570:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390488.597759:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788390488.597797:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788390488.597925:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788390488.597958:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788390488.598062:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788390488.598100:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788390488.598129:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788390488.598155:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788390488.598178:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390488.598215:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.598279:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.598339:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255552 00000100:00100000:1.0:1788390488.598350:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255552 00000100:00100000:0.0:1788390488.598469:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390488.598479:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390488.598618:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255552:12345-0@lo:502:mount.lustre.0 Request processed in 141us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.598625:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390488.598697:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390488.598770:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788390488.598779:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788390488.600159:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390488.600169:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600172:0:15057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390488.600181:0:15057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d69ef6c800 00000020:00000080:1.0:1788390488.600183:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390488.600191:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390488.600193:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600195:0:15057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390488.600197:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390488.600200:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600201:0:15057:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390488.600205:0:15057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d69ef6c800 00000020:00000080:1.0:1788390488.600207:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390488.600266:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390488.600270:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600271:0:15057:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390488.600274:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390488.600277:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600278:0:15057:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390488.600282:0:15057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d69ef6c800 00000020:00000080:1.0:1788390488.600284:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390488.600321:0:15057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390488.600324:0:15057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390488.600326:0:15057:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390488.600329:0:15057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788390488.602930:0:15039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390488.602988:0:15039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390488.603014:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.603027:0:15039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390488.603072:0:15039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390488.603075:0:15039:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d69ef6c800 10000000:01000000:3.0:1788390488.603078:0:15039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d69ef6c800 10000000:01000000:3.0:1788390488.603082:0:15039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390488.603088:0:15039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d69ef6c800 from 1 10000000:01000000:3.0:1788390488.603091:0:15039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390488.603126:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.603136:0:15039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.603147:0:15039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390488.603171:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390488.603235:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.603277:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.603911:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255680 00000100:00100000:1.0:1788390488.603919:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255680 00000100:00100000:1.0:1788390488.603978:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390488.603988:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103255680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390488.604002:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390488.604014:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd32e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32e3b expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.604049:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd32e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e3b expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.604060:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd32e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e3b expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390488.604070:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62c00, rc 0) 00000100:00100000:1.0:1788390488.604111:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103255680:12345-0@lo:101:mount.lustre.0 Request processed in 125us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.604118:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390488.604950:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390488.604983:0:15039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e42 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.604993:0:15039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32e42 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390488.605523:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788390488.605794:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390488.607181:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788390488.607231:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788390488.607266:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788390488.607311:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788390488.607350:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788390488.607397:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788390488.607448:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788390488.607479:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788390488.607522:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788390488.607553:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788390488.607585:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788390488.607636:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788390488.607670:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788390488.607699:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788390488.607742:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788390488.607778:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788390488.610006:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788390488.610112:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788390488.610153:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788390488.610189:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788390488.610240:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788390488.610278:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788390488.610331:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788390488.610394:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788390488.610433:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788390488.610470:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788390488.610520:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788390488.610556:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788390488.610642:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788390488.610650:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788390488.610761:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390488.610833:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.617023:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390488.617277:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255808 00000100:00100000:0.0:1788390488.617287:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255808 00000100:00100000:0.0:1788390488.617377:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390488.617388:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103255808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390488.617679:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103255808:12345-0@lo:501:mount.lustre.0 Request processed in 293us (6845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.617687:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390488.617759:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390488.617871:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390488.617925:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.618031:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.618108:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103255936 00000100:00100000:1.0:1788390488.618113:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103255936 00000100:00100000:1.0:1788390488.618135:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390488.618140:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103255936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390488.618299:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103255936:12345-0@lo:503:mount.lustre.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.618306:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390488.618373:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103255936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390488.618931:0:15039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390488.619034:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390488.619070:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.619086:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.619148:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256064 00000100:00100000:1.0:1788390488.619153:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256064 00000100:00100000:1.0:1788390488.619176:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788390488.619183:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103256064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390488.619354:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103256064:12345-0@lo:502:mount.lustre.0 Request processed in 171us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.619362:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390488.619444:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390488.619665:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788390488.619711:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788390488.619748:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788390488.619794:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788390488.619911:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788390488.620000:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788390488.620047:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788390488.620084:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788390488.620124:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788390488.620155:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788390488.620188:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788390488.620234:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788390488.620268:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788390488.620300:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788390488.620343:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788390488.620374:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788390488.620404:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788390488.620447:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788390488.620480:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788390488.620510:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788390488.620554:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788390488.620585:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788390488.620631:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788390488.620678:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788390488.620715:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788390488.620747:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788390488.620794:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788390488.623157:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788390488.623206:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788390488.623273:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788390488.623309:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788390488.623344:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788390488.623380:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788390488.623424:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788390488.623460:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788390488.623509:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788390488.623546:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788390488.623582:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788390488.623657:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788390488.623697:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788390488.623766:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390488.625986:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.626035:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390488.626115:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256192 00000100:00100000:1.0:1788390488.626123:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256192 00000100:00100000:1.0:1788390488.626185:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390488.626195:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103256192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390488.626455:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103256192:12345-0@lo:502:mount.lustre.0 Request processed in 261us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.626462:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788390488.626550:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390488.626656:0:15039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788390488.626672:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788390488.639630:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788390488.639648:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d6bc7599b8) 00000020:00000080:3.0:1788390488.639671:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788390488.639743:0:15062:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d69ef6c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390488.639748:0:15062:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d69ef6c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390488.639750:0:15062:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d69ef6c800 3 00010000:00080000:3.0:1788390488.639780:0:15062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6bc738800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390488.642473:0:15062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788390488.645141:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788390488.645180:0:15062:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390488.645193:0:15062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd32e50 00000100:00080000:3.0:1788390488.645203:0:15062:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390488.645209:0:15062:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d6bc738800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390488.645248:0:15062:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf7480 x1875263103256320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390488.645272:0:15062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788390488.645305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390488.645310:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390488.645312:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390488.645315:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788390488.645393:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103256448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390488.645461:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390488.645928:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103256320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788390488.645987:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.647073:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256448 00000100:00100000:0.0:1788390488.647082:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256448 00000100:00100000:0.0:1788390488.647122:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256320 00000100:00100000:0.0:1788390488.647124:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256320 00000100:00100000:0.0:1788390488.647137:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390488.647146:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103256448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390488.647214:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103256448:12345-0@lo:400:kworker.0 Request processed in 68us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.647220:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390488.647238:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390488.647242:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103256320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390488.647263:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:0.0:1788390488.647291:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd32e57 00000004:00100000:0.0:1788390488.647306:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390488.647335:0:14355:0:(import.c:65:import_set_state_nolock()) ffff95d585123000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390488.647375:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103256320:12345-0@lo:38:llog_process_th.0 Request processed in 131us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.647388:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788390488.647433:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bbcf7480 x1875263103256320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390488.647443:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390488.647451:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788390488.647457:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788390488.647461:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390488.647463:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bc738800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390488.647468:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103256320:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390488.647500:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bbcf4380 x1875263103256448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390488.647511:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103256448:0@lo:400:kworker.0 00000040:00080000:3.0:1788390488.649158:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788390488.649231:0:15039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788390488.649256:0:15039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390488.649271:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e42 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.649283:0:15039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd32e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e42 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788390488.649325:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788390488.649327:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390488.649328:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390488.649329:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390488.649331:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390488.649333:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390488.649334:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390488.649336:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390488.649337:0:15039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390488.649341:0:15039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788390488.649343:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390488.649345:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390488.649346:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390488.649347:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390488.649348:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390488.649349:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390488.649350:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390488.649351:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390488.649352:0:15039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390488.649373:0:15039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788390488.649390:0:15039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390488.649444:0:15039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.649477:0:15039:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390488.650955:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256576 00000100:00100000:2.0:1788390488.650983:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256576 00000100:00100000:2.0:1788390488.651033:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390488.651042:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15039:x1875263103256576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390488.651082:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390488.651096:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788390488.676954:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390488.677126:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788390488.680826:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390488.680836:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788390488.680936:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.680957:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.680993:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.681036:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.681049:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 16 pid: 14348 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390488.681064:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103256704:0@lo:104: 00000100:00100000:3.0:1788390488.681128:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390488.681167:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390488.681533:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256704 00000100:00100000:0.0:1788390488.681541:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256704 00000100:00100000:0.0:1788390488.681579:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390488.681587:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103256704:12345-0@lo:104: 00010000:00010000:0.0:1788390488.681600:0:14337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681661:0:14337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390488.681667:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103256704:12345-0@lo:104: Request processed in 81us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.681675:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788390488.681695:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390488.681701:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681722:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390488.681726:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681734:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390488.681741:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390488.681747:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390488.681773:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681780:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390488.681797:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681814:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd32dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32dcb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.681831:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390488.681833:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390488.681835:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390488.681853:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103256832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390488.681881:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390488.681950:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256832 00000100:00100000:0.0:1788390488.681954:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256832 00010000:00010000:0.0:1788390488.681997:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 17 pid: 14348 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390488.682023:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390488.682029:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+17:3287:x1875263103256832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390488.682039:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390488.682044:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 17 pid: 14348 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682054:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 17 pid: 14348 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682069:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682076:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788390488.682088:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001252125s 00010000:00010000:0.0:1788390488.682092:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682098:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682104:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682110:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682115:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390488.682125:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682132:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682140:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390488.682150:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390488.682179:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+17:3287:x1875263103256832:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390488.682186:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390488.682230:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103256832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390488.682352:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd32dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32dc4 expref: 16 pid: 14348 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390488.682363:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103256704:0@lo:104: 00010000:00010000:3.0:1788390488.682376:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.682383:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.682389:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390488.682407:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd32e5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390488.683307:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+15:15039:x1875263103256576:12345-0@lo:253:mount.lustre.0 Request processed in 32261us (33858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390488.683318:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788390488.683383:0:15039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15039:1875263103256576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390488.683395:0:15039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788390488.683398:0:15039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390488.683400:0:15039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390488.683401:0:15039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390488.683402:0:15039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390488.683404:0:15039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390488.683405:0:15039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390488.683406:0:15039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390488.683408:0:15039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390488.683409:0:15039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788390488.683421:0:15039:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390488.692634:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390488.692800:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390488.693129:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390488.693254:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390488.693375:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390488.693515:0:15039:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788390488.694239:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788390488.732236:0:15039:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788390488.732245:0:15039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788390488.732277:0:15039:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788390488.732351:0:15039:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788390488.732366:0:15039:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788390488.732394:0:15039:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788390489.170335:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.189315:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390490.707552:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390480/real 1788390480] req@ffff95d68a7e5c00 x1875263103250688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.707600:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d68a7e5c00 x1875263103250688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.707610:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390480/real 1788390480] req@ffff95d6bc03d880 x1875263103250560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.707621:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d6bc03d880 x1875263103250560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390490.707641:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390490.707659:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788390490.707664:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103250688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788390490.707670:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d686d55000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390490.707675:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788390490.707679:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103250560:0@lo:8:llog_process_th.0 10000000:01000000:3.0:1788390490.708046:0:14351:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390490.708050:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68527e000 from 7 10000000:01000000:3.0:1788390490.708059:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390490.708102:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.708112:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.708125:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390490.708145:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103256960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390490.708209:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390490.708252:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390490.708270:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103256960 00000100:00100000:3.0:1788390490.708277:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103256960 00000100:00100000:3.0:1788390490.708320:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788390490.708330:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+15:14351:x1875263103256960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390490.708343:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390490.708355:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32e65 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.708377:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.708386:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 16 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.708395:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00080000:2.0:1788390490.708519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390490.708524:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788390490.708527:0:36:0:(import.c:65:import_set_state_nolock()) ffff95d686d55000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390490.708531:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 297 00000100:00080000:2.0:1788390490.708535:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390490.708539:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d686d55000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390490.708558:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc03d880 x1875263103257088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390490.708572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390490.708575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390490.708583:0:36:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390490.708587:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 297 00000100:00080000:2.0:1788390490.708589:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390490.708592:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6a0fa9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390490.708605:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc03f100 x1875263103257216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390490.708655:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788390490.709647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390490.709683:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390490.709691:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103257472:0@lo:400:kworker.0 00000100:00100000:2.0:1788390490.710845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390490.710918:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257344 00000100:00100000:2.0:1788390490.710926:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257344 00000100:00100000:2.0:1788390490.710985:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257472 00000100:00100000:2.0:1788390490.710989:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257472 00000100:00100000:2.0:1788390490.711014:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390490.711023:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103257344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390490.711074:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103257344:12345-0@lo:400:kworker.0 Request processed in 51us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390490.711080:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390490.711096:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390490.711101:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103257472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390490.711126:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103257472:12345-0@lo:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390490.711130:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788390490.711161:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390490.711198:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc03dc00 x1875263103257472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.711210:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103257472:0@lo:400:kworker.0 00010000:00080000:2.0:1788390490.711220:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc03df80 x1875263103257344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.711227:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788390490.711250:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103257088:0@lo:8:kworker.0 00000100:00100000:2.0:1788390490.711278:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390490.711303:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103257216:0@lo:8:kworker.0 00000100:00100000:2.0:1788390490.711322:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390490.711363:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257088 00000100:00100000:2.0:1788390490.711367:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257088 00000100:00100000:2.0:1788390490.711383:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257216 00000100:00100000:2.0:1788390490.711385:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257216 00000100:00100000:2.0:1788390490.711394:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390490.711398:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103257088:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788390490.711811:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:14351:x1875263103256960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3481us (3600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390490.711828:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788390490.711888:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103256960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390490.711910:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.711922:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390490.711990:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103257600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390490.712031:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390490.712048:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390490.712062:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257600 00000100:00100000:3.0:1788390490.712066:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257600 00000100:00100000:3.0:1788390490.712089:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390490.712095:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+16:14351:x1875263103257600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788390490.712109:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788390490.712124:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788390490.712126:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788390490.712196:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+16:14351:x1875263103257600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390490.712202:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390490.712236:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103257600:0@lo:256:ll_cfg_requeue.0 00010000:00080000:2.0:1788390490.712301:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1788390490.712329:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd32e73 00002000:00100000:2.0:1788390490.712341:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d6a6b04800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788390490.712345:0:15042:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788390490.712348:0:15042:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788390490.712684:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788390490.714537:0:15042:0:(import.c:65:import_set_state_nolock()) ffff95d6a6b04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390490.714626:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103257088:12345-0@lo:8:kworker.0 Request processed in 3223us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390490.714651:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390490.714684:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390490.714690:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103257216:12345-0@lo:8:kworker.0 10000000:01000000:3.0:1788390490.717613:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390490.717627:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.717651:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:2.0:1788390490.720091:0:15042:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788390490.720178:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103257216:12345-0@lo:8:kworker.0 Request processed in 5484us (8850us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788390490.720189:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390490.720264:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc03d880 x1875263103257088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390490.720276:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390490.720287:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788390490.720296:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788390490.720302:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788390490.720306:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d686d55000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788390490.720325:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788390490.720331:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103257088:0@lo:8:kworker.0 00000100:00080000:2.0:1788390490.720344:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390490.720348:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390490.720351:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103257216:0@lo:8:kworker.0 00000004:00080000:1.0:1788390490.720470:0:14377:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788390490.720492:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875263103257856:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788390490.720531:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390490.720553:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390490.720564:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390490.720572:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103257728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390490.720596:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390490.720629:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257856 00000100:00100000:1.0:1788390490.720635:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257856 00000100:00100000:1.0:1788390490.720682:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390490.720690:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14377:x1875263103257856:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788390490.721815:0:14376:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390490.722067:0:14376:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307829105708ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788390490.723099:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257728 00000100:00100000:2.0:1788390490.723110:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257728 00000100:00100000:2.0:1788390490.723166:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390490.723177:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103257728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390490.723209:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390490.723288:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103257728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390490.723304:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788390490.723328:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788390490.724991:0:15043:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788390490.725002:0:15043:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788390490.725007:0:15043:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:0.0:1788390490.732044:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d68a7e5880 x1875263103257728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390490.732073:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103257728:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788390490.740411:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390490.740426:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740455:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788390490.740461:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390490.740468:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740488:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740499:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740507:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740530:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390490.740545:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390490.740551:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740559:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390490.740565:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740576:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740606:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740614:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd32e7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.740644:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.740700:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.740702:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390490.744480:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390490.744490:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.744503:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788390490.744507:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390490.744512:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.744522:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.744529:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.744534:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.744566:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390490.744779:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390490.744788:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.744797:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390490.744803:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.744813:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.744843:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.744850:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd32e81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.744871:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.744873:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.744875:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390490.745114:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390490.745121:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.745129:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788390490.745132:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390490.745136:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.745147:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.745155:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.745163:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.745184:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390490.745195:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390490.745201:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.745209:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390490.745213:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.745427:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.745441:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.745448:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd32e88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.745472:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.745474:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.745476:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390490.748094:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390490.748107:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748123:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1788390490.748128:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390490.748135:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748150:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748161:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748168:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748194:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390490.748211:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390490.748220:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.748231:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390490.748242:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.748252:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.748268:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.748276:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd32e8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.748298:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.748300:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.748302:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390490.748652:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390490.748658:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748673:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1788390490.748676:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390490.748681:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.748691:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.750388:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.750401:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.752042:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390490.752052:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390490.752062:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.752074:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390490.752079:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.752090:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.752113:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.752129:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd32e96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390490.752153:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.752155:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390490.752158:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390490.752952:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.754198:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754220:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.754225:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.754232:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754252:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754264:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754272:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754291:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390490.754305:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390490.754310:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754318:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.754331:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754340:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754356:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754363:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a59358d/0x9aafc5f04cd32e9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.754381:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.754383:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.754385:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390490.757640:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.757651:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.757666:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.757671:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.757677:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.757693:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.758381:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.758397:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.758458:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390490.759030:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.759038:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.759049:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.759053:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.759058:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.759069:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.759078:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.759084:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760331:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390490.760342:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760354:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.760359:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760369:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760402:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760410:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b62179/0x9aafc5f04cd32ea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760443:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.760447:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760455:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.760459:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760466:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760477:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.760485:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.760488:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.760490:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.760591:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.760598:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002015c470/0x9aafc5f04cd32eab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.761181:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.761189:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.761200:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.761205:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.761210:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.761222:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.761231:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.761240:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.761428:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.761435:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.761456:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.761460:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.761468:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.761481:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.761490:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.761492:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.761496:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.761553:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.761558:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd32eb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390490.762069:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788390490.762154:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.762161:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.762179:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.762182:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.762187:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.762198:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.762206:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.762213:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.762305:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.762310:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.762317:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.762320:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.762327:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.762336:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.762348:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.762349:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.762351:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.762678:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.762684:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd32eb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.763216:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.763222:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.763231:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.763234:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.763239:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.763259:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.763267:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.763275:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.763425:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.763432:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.763439:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.763443:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.763451:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.763462:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.763470:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.763472:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.763473:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.763535:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.763541:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017df106f/0x9aafc5f04cd32ec0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.764230:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.764237:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.764247:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.764250:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.764254:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.764265:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.764288:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.764295:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.764396:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.764403:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.764412:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.764417:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.764432:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.764447:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.764456:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.764458:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.764461:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.764533:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.764539:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd32ec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.765211:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.765219:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.765228:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.765231:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.765236:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.765247:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.765256:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.765274:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.765318:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.765324:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.765332:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.765336:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.765344:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.765355:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.765363:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.765364:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.765366:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.765432:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.765438:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd32ece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.766076:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.766083:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.766091:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.766095:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.766100:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.766110:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.766118:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.766126:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.766286:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.766292:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.766300:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.766304:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.766313:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.766325:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.766334:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.766336:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.766338:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.766402:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.766408:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd32ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.767028:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.767035:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.767044:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.767048:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.767052:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.767062:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.767071:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.767079:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.767124:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.767130:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.767137:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.767141:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.767149:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.767172:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.767181:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.767183:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.767185:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.767239:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.767244:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004be1a2b0/0x9aafc5f04cd32edc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.768105:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.768114:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.768125:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.768128:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.768134:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.768146:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.768155:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.768163:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.768214:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.768220:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.768227:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.768232:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.768240:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.768253:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.768261:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.768263:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.768265:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.768323:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.768328:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1ccd90/0x9aafc5f04cd32ee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.768928:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.768935:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.768955:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.769045:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.769051:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.769062:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.769070:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.769078:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.769127:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.769132:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.769151:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.769155:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.769163:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.769177:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.769185:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.769187:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.769189:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.769248:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.769254:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd32eea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390490.769928:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390490.769935:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.769945:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788390490.769948:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390490.769952:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.769999:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.770008:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.770016:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.771199:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.771209:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.771219:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdca00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.771224:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.771233:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.771251:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.771270:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.771272:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.771274:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.771366:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390490.771373:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e8896b8/0x9aafc5f04cd32ef1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390490.772436:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.772444:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.772457:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.772461:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.772468:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.772479:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.772488:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.772495:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.772545:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.772551:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.772558:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.772562:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.772570:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.772592:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.772602:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.772603:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390490.772605:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.773003:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390490.773010:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd32ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390490.773448:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.773454:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.773463:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.773467:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.773471:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.773481:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.773490:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.773497:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.775689:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390490.775712:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.775725:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390490.775730:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.775752:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.775775:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.775897:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.775900:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.775902:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.776057:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390490.776066:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071afbbad/0x9aafc5f04cd32eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390490.776670:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.776678:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390490.776775:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.776803:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.776808:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.776814:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.776826:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.776835:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.776843:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.776910:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390490.777340:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.777346:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.777354:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.777357:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.777361:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.777370:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.777389:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.777396:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781019:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390490.781036:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781050:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.781056:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781067:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781100:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781107:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a97762/0x9aafc5f04cd32f06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781145:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390490.781150:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781157:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.781161:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781168:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781180:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.781189:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.781191:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.781193:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.781272:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390490.781281:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a316226/0x9aafc5f04cd32f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390490.782024:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.782032:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782044:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.782048:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.782054:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782067:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782075:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782094:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782109:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390490.782503:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.782509:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782518:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.782521:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.782525:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782535:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782543:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782550:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.782558:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788390490.782805:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390490.782811:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782831:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.782835:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782843:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782858:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782865:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32f14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782891:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390490.782895:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782901:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.782905:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782912:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782922:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782936:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd32f1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.782949:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.782951:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.782953:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.782976:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390490.783273:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.783279:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783293:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.783296:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.783301:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783310:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783318:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783326:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783383:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390490.783857:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.783863:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783871:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.783874:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.783888:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783897:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783917:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.783925:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784039:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390490.784045:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784053:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.784057:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784065:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784078:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784086:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32f22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784099:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390490.784103:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784117:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.784120:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784127:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784137:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784144:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.784146:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.784147:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.784224:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390490.784229:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd32f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390490.784645:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390490.784651:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.784660:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788390490.784663:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390490.784667:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.784677:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.784685:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390490.784768:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784794:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390490.784799:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784805:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390490.784808:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784815:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784825:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390490.784840:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.784841:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390490.784843:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390490.784909:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390490.784914:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009942e9c8/0x9aafc5f04cd32f30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788390490.785116:0:15043:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788390490.785215:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14377:x1875263103257856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 64521us (64679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390490.785227:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390490.785335:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875263103257856:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788390490.785351:0:14377:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788390490.785396:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875263103257984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788390490.785430:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390490.785469:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390490.785514:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103257984 00000100:00100000:0.0:1788390490.785521:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103257984 00000100:00100000:0.0:1788390490.785596:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390490.785606:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14377:x1875263103257984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788390490.785644:0:15042:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1788390490.786043:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390490.795204:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14377:x1875263103257984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9592us (9765us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788390490.795220:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390490.795657:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875263103257984:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788390490.795673:0:14377:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788390491.214174:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390492.237125:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390492.557167:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390492.557178:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390492.557209:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788390492.557215:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1788390493.254622:0:15404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788390493.263443:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390494.290627:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788390494.300475:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788390494.300511:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788390495.315413:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390496.206378:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103258240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390496.206464:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390496.206549:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258240 00000100:00100000:2.0:1788390496.206558:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258240 00000100:00100000:2.0:1788390496.206629:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390496.206638:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103258240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390496.206680:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390496.206734:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103258240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390496.206741:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788390496.206766:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390496.206794:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788390496.206818:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103258240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390496.207151:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390496.207156:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788390496.207160:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390496.207166:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 307 00000100:00080000:3.0:1788390496.207171:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788390496.207176:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6a0fa9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390496.207945:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf7800 x1875263103258368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390496.208055:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103258624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390496.208698:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103258112:0@lo:400:kworker.0 00000100:00100000:2.0:1788390496.208772:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390496.208859:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103258496:0@lo:400:kworker.0 00000100:00100000:2.0:1788390496.208892:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390496.208938:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258496 00000100:00100000:2.0:1788390496.208946:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258496 00000100:00100000:2.0:1788390496.209018:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390496.209029:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103258496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390496.209098:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103258496:12345-0@lo:400:kworker.0 Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390496.209105:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390496.209150:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bbcf4380 x1875263103258496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390496.209165:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103258496:0@lo:400:kworker.0 00000100:00100000:3.0:1788390496.210512:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390496.210747:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103258368:0@lo:8:kworker.0 00000100:00100000:1.0:1788390496.210803:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390496.211510:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258624 00000100:00100000:3.0:1788390496.211522:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258624 00000100:00080000:1.0:1788390496.211819:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390496.212155:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258368 00000100:00100000:0.0:1788390496.212180:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258368 00000100:00100000:0.0:1788390496.212237:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390496.212247:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1875263103258368:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788390496.212273:0:15043:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788390496.212440:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258112 00000100:00100000:2.0:1788390496.212446:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258112 00000100:00100000:2.0:1788390496.212482:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390496.212490:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:3287:x1875263103258112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390496.212854:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390496.212865:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103258624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390496.212922:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103258624:12345-0@lo:400:kworker.0 Request processed in 59us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390496.212930:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788390496.213011:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bbcf7480 x1875263103258624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390496.213028:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103258624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390496.213495:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:3287:x1875263103258112:12345-0@lo:400:kworker.0 Request processed in 1004us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390496.213503:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390496.215350:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103258112:0@lo:400:kworker.0 00000100:00100000:0.0:1788390496.221723:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1875263103258368:12345-0@lo:8:kworker.0 Request processed in 9463us (10906us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390496.221784:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788390496.222120:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390496.222127:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390496.222132:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103258368:0@lo:8:kworker.0 00010000:00010000:0.0:1788390496.333109:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390497.359412:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390498.382200:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788390498.688830:0:15754:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788390498.688835:0:15754:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788390498.688944:0:15754:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d686d4d800 00000020:01000004:0.0:1788390498.689025:0:15754:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788390498.689036:0:15754:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788390498.689047:0:15754:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d69131b370) 00000020:00000080:0.0:1788390498.689060:0:15754:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788390498.700163:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788390498.700340:0:15754:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788390498.704926:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788390498.705233:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788390498.705421:0:15754:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788390498.705784:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:0.0:1788390498.706084:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:0.0:1788390498.706177:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:0.0:1788390498.706659:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788390498.706905:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:0.0:1788390498.707228:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788390498.707465:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788390498.707712:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:0.0:1788390498.708098:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:0.0:1788390498.708658:0:15754:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788390498.708670:0:15754:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390498.708680:0:15754:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd32f3e 00000020:01000004:0.0:1788390498.708688:0:15754:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788390498.708708:0:15754:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788390498.708711:0:15754:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788390498.708716:0:15754:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788390498.708736:0:15754:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788390498.708739:0:15754:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788390498.716874:0:15754:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390498.716912:0:15754:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788390498.716917:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390498.716919:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390498.716920:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390498.716921:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390498.716922:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390498.716923:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390498.716925:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390498.716926:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390498.716928:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390498.716931:0:15754:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788390498.716933:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390498.716935:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390498.716936:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390498.716937:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390498.716938:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390498.716939:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390498.716941:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390498.716941:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390498.716942:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390498.717040:0:15754:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788390498.717063:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103258752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390498.717133:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.717254:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.717303:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258752 00000100:00100000:3.0:1788390498.717310:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258752 00000100:00100000:3.0:1788390498.717397:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788390498.717408:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15754:x1875263103258752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390498.717448:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788390498.717452:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788390498.717456:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788390498.729066:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15754:x1875263103258752:12345-0@lo:253:mount.lustre.0 Request processed in 11650us (11923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390498.729083:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788390498.729210:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103258752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390498.729226:0:15754:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788390498.729229:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390498.729243:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390498.729245:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390498.729246:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390498.729248:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390498.729249:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390498.729251:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390498.729253:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390498.729254:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390498.729276:0:15754:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d686d4d800 from lustre-OST0001 10000000:01000000:3.0:1788390498.729302:0:15754:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788390498.729306:0:15754:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788390498.729313:0:15754:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d68a660000 local copy 00010000:00010000:3.0:1788390498.729323:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390498.729528:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103258880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390498.729562:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.729587:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390498.729643:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103258880 00000100:00100000:2.0:1788390498.729649:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103258880 00000100:00100000:2.0:1788390498.729699:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390498.729716:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15754:x1875263103258880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390498.730015:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15754:x1875263103258880:12345-0@lo:501:mount.lustre.0 Request processed in 306us (452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390498.730031:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788390498.730470:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103258880:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788390498.730487:0:15754:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390498.730640:0:15754:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390498.730647:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.730657:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd32ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32cf2 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390498.730684:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d686d4d800 10000000:01000000:3.0:1788390498.730688:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390498.730694:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788390498.730697:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390498.731856:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788390498.731867:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788390498.731904:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.731915:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.731925:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390498.731945:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390498.732061:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.732102:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390498.732234:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259008 00000100:00100000:2.0:1788390498.732241:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259008 00000100:00100000:2.0:1788390498.732289:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788390498.732299:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:15754:x1875263103259008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390498.732311:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390498.732324:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc000/0x9aafc5f04cd32f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32f45 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.732347:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc000/0x9aafc5f04cd32f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f45 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.732357:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc000/0x9aafc5f04cd32f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f45 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.732365:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc000, rc 0) 00000100:00100000:2.0:1788390498.732399:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259008:12345-0@lo:101:mount.lustre.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390498.732405:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390498.732588:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390498.732602:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f4c expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.732611:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32f4c expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390498.733500:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788390498.734688:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390498.735037:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788390498.735078:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788390498.735104:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788390498.735142:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788390498.735172:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788390498.735199:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788390498.735256:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788390498.735273:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788390498.735353:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390498.735416:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.735564:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390498.735607:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259136 00000100:00100000:2.0:1788390498.735615:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259136 00000100:00100000:2.0:1788390498.735696:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390498.735707:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390498.736218:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259136:12345-0@lo:501:mount.lustre.0 Request processed in 512us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390498.736226:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390498.736309:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390498.736344:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390498.736385:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.736537:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.736599:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259264 00000100:00100000:3.0:1788390498.736604:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259264 00000100:00100000:3.0:1788390498.736629:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390498.736636:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390498.736930:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259264:12345-0@lo:503:mount.lustre.0 Request processed in 293us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.736937:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390498.737057:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788390498.737843:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390498.737914:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390498.737986:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.738014:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.738081:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259392 00000100:00100000:3.0:1788390498.738086:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259392 00000100:00100000:3.0:1788390498.738111:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390498.738118:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390498.738294:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259392:12345-0@lo:502:mount.lustre.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.738301:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788390498.738386:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390498.738587:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788390498.738632:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788390498.738668:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788390498.738718:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788390498.738755:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788390498.738790:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788390498.738853:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788390498.738889:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788390498.738954:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788390498.739245:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390498.739285:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.739354:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.739391:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259520 00000100:00100000:3.0:1788390498.739396:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259520 00000100:00100000:3.0:1788390498.739434:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390498.739443:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390498.739678:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259520:12345-0@lo:502:mount.lustre.0 Request processed in 236us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.739685:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390498.739794:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390498.739865:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788390498.739875:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788390498.740798:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390498.740814:0:15755:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788390498.740827:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.740829:0:15755:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788390498.740835:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390498.740849:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d6bc758000) 00000020:00000080:3.0:1788390498.740872:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788390498.740878:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390498.740947:0:15755:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d686d4d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788390498.740955:0:15755:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390498.741113:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd32f5a 00010000:00010000:3.0:1788390498.746579:0:15755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788390498.747068:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788390498.748579:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788390498.749665:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788390498.749676:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390498.749682:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.749684:0:15755:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788390498.749687:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390498.749691:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.749692:0:15755:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390498.749695:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390498.749697:0:15755:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390498.749699:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390498.749702:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.749703:0:15755:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390498.749705:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390498.749707:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.749708:0:15755:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390498.749711:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788390498.749830:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390498.749835:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390498.749836:0:15755:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390498.749839:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788390498.754053:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788390498.754094:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788390498.754142:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f4c expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.754153:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1e00/0x9aafc5f04cd32f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f4c expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390498.754159:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d686d4d800 from 1 10000000:01000000:2.0:1788390498.754161:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390498.754191:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.754197:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.754206:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390498.754223:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390498.754289:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390498.754325:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.755176:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259648 00000100:00100000:1.0:1788390498.755185:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259648 00000100:00100000:1.0:1788390498.755226:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390498.755233:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+17:15754:x1875263103259648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390498.755248:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390498.755262:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32f61 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.755287:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.755297:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.755313:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390498.755351:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103259648:12345-0@lo:101:mount.lustre.0 Request processed in 119us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.755356:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390498.755675:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390498.755687:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.755693:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390498.756170:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788390498.756486:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390498.756627:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788390498.756651:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788390498.756682:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788390498.756687:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788390498.756734:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390498.756777:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390498.756821:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.756997:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259776 00000100:00100000:3.0:1788390498.757007:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259776 00000100:00100000:3.0:1788390498.757032:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390498.757038:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103259776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390498.757186:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103259776:12345-0@lo:501:mount.lustre.0 Request processed in 148us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.757192:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390498.757234:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390498.757265:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390498.757300:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.757319:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103259904 00000100:00100000:3.0:1788390498.757322:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103259904 00000100:00100000:3.0:1788390498.757335:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390498.757339:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103259904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390498.757526:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103259904:12345-0@lo:503:mount.lustre.0 Request processed in 185us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.757530:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390498.757556:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.757564:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103259904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390498.757886:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390498.757943:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390498.757998:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390498.758021:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260032 00000100:00100000:3.0:1788390498.758024:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.758026:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260032 00000100:00100000:1.0:1788390498.758064:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390498.758072:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103260032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390498.758231:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103260032:12345-0@lo:502:mount.lustre.0 Request processed in 160us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.758247:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788390498.759193:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390498.759375:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788390498.759409:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788390498.759434:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788390498.759452:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788390498.759468:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788390498.759491:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788390498.759509:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788390498.759524:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788390498.759545:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390498.759583:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390498.759605:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.759622:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260160 00000100:00100000:1.0:1788390498.759627:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260160 00000100:00100000:1.0:1788390498.759673:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390498.759682:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103260160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390498.760098:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103260160:12345-0@lo:502:mount.lustre.0 Request processed in 416us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.760106:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788390498.760115:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390498.760178:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788390498.760185:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788390498.760676:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390498.760683:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760685:0:15759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390498.760690:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d686d4d800 00000020:00000080:1.0:1788390498.760691:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390498.760697:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390498.760698:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760699:0:15759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390498.760701:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390498.760718:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760719:0:15759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390498.760722:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d686d4d800 00000020:00000080:1.0:1788390498.760724:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390498.760772:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390498.760776:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760777:0:15759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390498.760779:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390498.760789:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760791:0:15759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390498.760794:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d686d4d800 00000020:00000080:1.0:1788390498.760795:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390498.760841:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390498.760844:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390498.760845:0:15759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390498.760847:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788390498.761031:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390498.761052:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390498.764179:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.764201:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390498.764277:0:15754:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390498.764280:0:15754:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d686d4d800 10000000:01000000:3.0:1788390498.764283:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d686d4d800 10000000:01000000:3.0:1788390498.764288:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390498.764294:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d686d4d800 from 1 10000000:01000000:3.0:1788390498.764297:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390498.764333:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.764342:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.764353:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390498.764376:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390498.764444:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.764488:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.764573:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260288 00000100:00100000:1.0:1788390498.764582:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260288 00000100:00100000:1.0:1788390498.764673:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390498.764684:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103260288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390498.764697:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390498.764709:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd32f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32f6f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.764733:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd32f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f6f expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.764743:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd32f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f6f expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390498.764751:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390498.764816:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260288:12345-0@lo:101:mount.lustre.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.764829:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788390498.764851:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390498.764869:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f76 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.764878:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32f76 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390498.765521:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788390498.765924:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390498.766226:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788390498.766268:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788390498.766302:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788390498.766351:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788390498.766390:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788390498.766438:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788390498.766473:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788390498.766502:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788390498.766560:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788390498.766596:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788390498.766630:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788390498.766678:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788390498.766715:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788390498.766750:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788390498.766797:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788390498.766847:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788390498.766897:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788390498.766946:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788390498.767004:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788390498.767040:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788390498.767084:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788390498.767117:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788390498.767149:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788390498.767199:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788390498.767230:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788390498.767261:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788390498.767308:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788390498.767345:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788390498.767377:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788390498.767422:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788390498.767456:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788390498.767488:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788390498.767536:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788390498.767583:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788390498.767618:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788390498.767674:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788390498.767711:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788390498.767795:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788390498.767803:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788390498.769872:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390498.769939:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.770003:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260416 00000100:00100000:1.0:1788390498.770006:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390498.770011:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260416 00000100:00100000:0.0:1788390498.770053:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390498.770062:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390498.770305:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260416:12345-0@lo:501:mount.lustre.0 Request processed in 243us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390498.770313:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390498.770332:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390498.770362:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390498.770402:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390498.770425:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390498.770848:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260544 00000100:00100000:0.0:1788390498.770853:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260544 00000100:00100000:0.0:1788390498.770888:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788390498.770896:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390498.771447:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260544:12345-0@lo:503:mount.lustre.0 Request processed in 550us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.771454:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788390498.771674:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788390498.772208:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390498.772277:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390498.772322:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.772362:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.772769:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260672 00000100:00100000:1.0:1788390498.772775:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260672 00000100:00100000:1.0:1788390498.772835:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390498.772843:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390498.773125:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260672:12345-0@lo:502:mount.lustre.0 Request processed in 283us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.773132:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788390498.773255:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390498.773483:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788390498.773530:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788390498.773565:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788390498.773619:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788390498.773656:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788390498.773703:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788390498.773739:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788390498.773785:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788390498.773846:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788390498.773882:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788390498.773916:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788390498.773977:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788390498.774014:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788390498.774045:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788390498.774092:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788390498.774129:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788390498.774161:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788390498.774203:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788390498.774236:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788390498.774271:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788390498.774317:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788390498.774353:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788390498.774386:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788390498.774444:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788390498.774477:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788390498.774509:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788390498.774556:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788390498.774602:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788390498.774634:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788390498.774682:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788390498.774717:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788390498.774748:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788390498.774779:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788390498.774836:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788390498.774870:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788390498.774910:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788390498.774940:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788390498.774993:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788390498.775039:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788390498.775084:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788390498.775118:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390498.775172:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.775205:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390498.775474:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260800 00000100:00100000:1.0:1788390498.775481:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260800 00000100:00100000:1.0:1788390498.775513:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390498.775521:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390498.775709:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103260800:12345-0@lo:502:mount.lustre.0 Request processed in 188us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.775717:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390498.776625:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103260800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390498.776714:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788390498.776726:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788390498.777696:0:15764:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788390498.777718:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d5873eb370) 00000020:00000080:2.0:1788390498.777738:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788390498.777803:0:15764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d686d4d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390498.777818:0:15764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d686d4d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390498.777820:0:15764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d686d4d800 3 00010000:00080000:2.0:1788390498.777852:0:15764:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d5810ca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788390498.779794:0:15764:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788390498.780047:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788390498.780079:0:15764:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390498.780090:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd32f84 00000100:00080000:2.0:1788390498.780099:0:15764:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390498.780104:0:15764:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5810ca800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390498.780137:0:15764:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc03ea00 x1875263103260928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390498.780164:0:15764:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390498.780219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390498.780223:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788390498.780226:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390498.780231:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 313 00000100:00100000:3.0:1788390498.780321:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103260928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788390498.780385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.780441:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103261056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390498.780468:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.780505:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261056 00000100:00100000:3.0:1788390498.780511:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261056 00000100:00100000:3.0:1788390498.780564:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390498.780573:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103261056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390498.780619:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103261056:12345-0@lo:400:kworker.0 Request processed in 46us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.780626:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788390498.780644:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390498.780671:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103261056:0@lo:400:kworker.0 00000100:00080000:1.0:1788390498.780719:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788390498.780726:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6a0fa9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390498.780741:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e4000 x1875263103261184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390498.780877:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103261184:0@lo:8:kworker.0 00000100:00100000:3.0:1788390498.780901:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.780929:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261184 00000100:00100000:3.0:1788390498.780933:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261184 00000100:00100000:3.0:1788390498.780951:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390498.780956:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103261184:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788390498.781019:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103261184:12345-0@lo:8:kworker.0 Request processed in 61us (116us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788390498.781025:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390498.781047:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390498.781052:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390498.781056:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788390498.781059:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103261184:0@lo:8:kworker.0 00000100:00100000:1.0:1788390498.781129:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103261312:0@lo:400:kworker.0 00000100:00100000:1.0:1788390498.781158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390498.781184:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390498.781190:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103261440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390498.781212:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390498.781319:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103260928 00000100:00100000:1.0:1788390498.781324:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103260928 00000100:00100000:1.0:1788390498.781339:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261312 00000100:00100000:1.0:1788390498.781341:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261312 00000100:00100000:1.0:1788390498.781356:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261440 00000100:00100000:1.0:1788390498.781359:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261440 00000100:00100000:1.0:1788390498.781380:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390498.781386:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103261312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390498.781422:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103261312:12345-0@lo:400:kworker.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.781428:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390498.781440:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390498.781446:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103261440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390498.781472:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103261440:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.781484:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390498.781497:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390498.781502:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103260928:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788390498.781517:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1788390498.781549:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd32f8b 00000004:00100000:1.0:1788390498.781563:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390498.781589:0:14355:0:(import.c:65:import_set_state_nolock()) ffff95d691c58800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390498.781625:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103260928:12345-0@lo:38:llog_process_th.0 Request processed in 121us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390498.781630:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788390498.781644:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788390498.781663:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc03ea00 x1875263103260928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390498.781672:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390498.781677:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788390498.781683:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788390498.781687:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390498.781689:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5810ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390498.781695:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103260928:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788390498.781717:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d68a7e6300 x1875263103261440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390498.781726:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103261440:0@lo:400:kworker.0 00010000:00080000:1.0:1788390498.781735:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d68a7e4700 x1875263103261312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390498.781753:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103261312:0@lo:400:kworker.0 00000040:00080000:2.0:1788390498.781863:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788390498.782044:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788390498.782072:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390498.782124:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f76 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.782135:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd32f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32f76 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390498.782174:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390498.782177:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390498.782178:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390498.782183:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390498.782184:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390498.782186:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390498.782187:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390498.782189:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390498.782190:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390498.782194:0:15754:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788390498.782196:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390498.782197:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390498.782199:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390498.782200:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390498.782200:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390498.782201:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390498.782202:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390498.782203:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390498.782204:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390498.782219:0:15754:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788390498.782230:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103261568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390498.782267:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390498.782294:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261568 00000100:00100000:0.0:1788390498.782298:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261568 00000100:00100000:0.0:1788390498.782326:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390498.782333:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:15754:x1875263103261568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788390498.782353:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788390498.782366:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788390498.783876:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683389c00 going to sleep for 11 seconds 20000000:01000000:0.0:1788390498.796076:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390498.796094:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788390498.796166:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390498.796171:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390498.796194:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.796212:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.796222:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.796259:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.796273:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 19 pid: 14348 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390498.796289:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103261696:0@lo:104: 00000100:00100000:2.0:1788390498.796344:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390498.796668:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261696 00000100:00100000:2.0:1788390498.796670:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390498.796676:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261696 00000100:00100000:3.0:1788390498.796723:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390498.796733:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103261696:12345-0@lo:104: 00010000:00010000:3.0:1788390498.796745:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390498.796990:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390498.796997:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+3:14370:x1875263103261696:12345-0@lo:104: Request processed in 266us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390498.797004:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390498.797009:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875263103261696:0@lo:104: 00010000:00010000:2.0:1788390498.797028:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797066:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390498.797073:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797081:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390498.797084:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797099:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390498.797106:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390498.797112:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390498.797137:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797143:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788390498.797217:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103261824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390498.797249:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390498.797409:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797418:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0e00/0x9aafc5f04cd32e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e6c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390498.797436:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390498.797437:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390498.797439:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390498.797589:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261824 00000100:00100000:2.0:1788390498.797594:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261824 00010000:00010000:2.0:1788390498.797612:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 20 pid: 14348 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390498.797796:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390498.797814:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+20:3286:x1875263103261824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390498.797826:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390498.797831:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 20 pid: 14348 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797840:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 20 pid: 14348 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797852:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd32e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32e65 expref: 20 pid: 14348 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797865:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797873:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390498.797884:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001714012s 00010000:00010000:2.0:1788390498.797888:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797904:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797911:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797917:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797923:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390498.797926:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797934:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797945:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.797954:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390498.798602:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103261824:12345-0@lo:103:ldlm_bl.0 Request processed in 796us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390498.798610:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788390498.798642:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.798650:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390498.798656:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd32f92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390498.798773:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103261824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390498.799928:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+18:15754:x1875263103261568:12345-0@lo:253:mount.lustre.0 Request processed in 17590us (17655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390498.799938:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788390498.799947:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6ebd9ca6-c84c-470c-bc70-726259965b52:15754:1875263103261568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788390498.799977:0:15754:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788390498.799981:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390498.799983:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390498.799984:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390498.799985:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390498.799986:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390498.799987:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390498.799989:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390498.799990:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390498.799992:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788390498.800004:0:15754:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390498.802315:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390498.802420:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390498.802515:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390498.802605:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390498.802704:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390498.802918:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788390498.803474:0:15754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788390498.825126:0:15754:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788390498.825136:0:15754:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788390498.825167:0:15754:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788390498.825216:0:15754:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788390498.825229:0:15754:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788390498.825266:0:15754:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788390499.406176:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390500.429069:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788390500.623886:0:14351:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788390500.623900:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68527e000 from 8 10000000:01000000:2.0:1788390500.623908:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390500.623994:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.624009:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.624023:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390500.624058:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103261952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390500.624160:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390500.624236:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390500.625472:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103261952 00000100:00100000:0.0:1788390500.625486:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103261952 00000100:00100000:0.0:1788390500.625574:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390500.625597:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103261952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390500.625627:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390500.625650:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b64fa000/0x9aafc5f04cd32fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd32f99 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390500.625682:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b64fa000/0x9aafc5f04cd32fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f99 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390500.625695:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b64fa000/0x9aafc5f04cd32fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f99 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390500.625707:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa000, rc 0) 00000100:00100000:0.0:1788390500.625830:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103261952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390500.625838:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788390500.626050:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103261952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390500.626072:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32fa0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.626083:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd32fa0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390500.626163:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103262080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788390500.626209:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390500.626245:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390500.626762:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262080 00000100:00100000:0.0:1788390500.626769:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262080 00000100:00100000:0.0:1788390500.626824:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390500.626833:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103262080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390500.626855:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390500.626874:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390500.626877:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788390500.626993:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103262080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390500.627002:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788390500.627272:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103262080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788390500.627407:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390500.627417:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32fa0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.627427:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdda00/0x9aafc5f04cd32f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd32fa0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390501.326278:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103262208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390501.326379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390501.329215:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262208 00000100:00100000:0.0:1788390501.329237:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262208 00000100:00080000:3.0:1788390501.329367:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390501.329394:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390501.329408:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103262208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390501.329465:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390501.329592:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103262208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390501.329601:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390501.329690:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103262208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390501.454244:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390502.477176:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390502.797347:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390502.797362:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390502.798075:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788390502.798087:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1788390503.117520:0:16110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788390503.502100:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390503.886364:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390503.886371:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788390503.886375:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390503.886387:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6a0fa9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390503.886408:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68a7e7800 x1875263103262592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390503.886504:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103262336:0@lo:400:kworker.0 00000100:00100000:1.0:1788390503.886575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390503.886623:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103262976:0@lo:400:kworker.0 00000100:00100000:1.0:1788390503.886648:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390503.886673:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390503.886679:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103262464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390503.886702:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390503.886731:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103262592:0@lo:8:kworker.0 00000100:00100000:1.0:1788390503.886753:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390503.886797:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262976 00000100:00100000:1.0:1788390503.886811:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262976 00000100:00100000:1.0:1788390503.886982:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390503.886992:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103262976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390503.887045:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103262976:12345-0@lo:400:kworker.0 Request processed in 55us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390503.887052:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788390503.887086:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a7e5f80 x1875263103262976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390503.887099:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103262976:0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.887829:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103262720:0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.887864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390503.887888:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390503.887902:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103262848:0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.887922:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390503.887949:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262720 00000100:00100000:2.0:1788390503.887954:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262720 00000100:00100000:2.0:1788390503.887990:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262848 00000100:00100000:2.0:1788390503.887993:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262848 00000100:00100000:2.0:1788390503.888010:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390503.888017:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103262720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.888047:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103262720:12345-0@lo:400:kworker.0 Request processed in 31us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390503.888051:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390503.888061:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390503.888065:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103262848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.888082:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103262848:12345-0@lo:400:kworker.0 Request processed in 17us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390503.888086:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788390503.888385:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a7e5c00 x1875263103262848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390503.888393:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103262848:0@lo:400:kworker.0 00010000:00080000:2.0:1788390503.888399:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a7e5880 x1875263103262720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390503.888404:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103262720:0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.890413:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262464 00000100:00100000:2.0:1788390503.890436:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262464 00000100:00100000:2.0:1788390503.890485:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262592 00000100:00100000:2.0:1788390503.890489:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262592 00000100:00100000:2.0:1788390503.890512:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390503.890519:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103262464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390503.890595:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103262464:12345-0@lo:400:kworker.0 Request processed in 77us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390503.890600:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390503.890613:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390503.890617:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103262592:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788390503.890622:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103262464:0@lo:400:kworker.0 00010000:00080000:2.0:1788390503.890638:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:2.0:1788390503.890668:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd32fa7 00002000:00100000:2.0:1788390503.890680:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d5810ca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788390503.890683:0:15042:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788390503.890685:0:15042:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788390503.891192:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103262336 00000100:00100000:0.0:1788390503.891197:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103262336 00000100:00100000:0.0:1788390503.891236:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390503.891245:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390503.891292:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103262336:12345-0@lo:400:kworker.0 Request processed in 48us (4717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390503.891300:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390503.892707:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103262336:0@lo:400:kworker.0 00002000:00080000:2.0:1788390503.893073:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788390503.893105:0:15042:0:(import.c:65:import_set_state_nolock()) ffff95d5810cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390503.893181:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103262592:12345-0@lo:8:kworker.0 Request processed in 2560us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390503.893192:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788390503.893412:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d68a7e7800 x1875263103262592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390503.893426:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788390503.893434:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788390503.893439:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788390503.893442:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fa9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788390503.893460:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788390503.893465:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103262592:0@lo:8:kworker.0 00000004:00080000:1.0:1788390503.893486:0:14378:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788390503.893991:0:14379:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788390503.894016:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875263103263232:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788390503.894061:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390503.894090:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390503.894218:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263232 00000100:00100000:0.0:1788390503.894225:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263232 00000004:00080000:1.0:1788390503.894472:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321001510494ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788390503.894499:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103263104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390503.894534:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390503.894573:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263104 00000100:00100000:2.0:1788390503.894578:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263104 00000100:00100000:2.0:1788390503.894624:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390503.894635:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103263104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390503.894661:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390503.894789:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103263104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390503.894795:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390503.894915:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390503.894924:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14379:x1875263103263232:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788390503.895018:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390503.895024:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390503.895029:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788390503.895681:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc03e300 x1875263103263104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390503.895700:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103263104:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788390503.899169:0:15043:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788390503.899184:0:15043:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788390503.899189:0:15043:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788390503.907392:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.907407:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.907425:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.907436:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.907824:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.907846:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.907857:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.907866:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.907885:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.908555:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.908563:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.908572:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.908576:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.908581:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.908592:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.908601:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.908614:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.908633:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788390503.909162:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.909168:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909178:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.909181:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.909185:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909196:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909204:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909212:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909222:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788390503.909839:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.909848:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909863:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.909866:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.909870:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909881:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909889:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909896:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.909906:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788390503.910576:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.910584:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.910593:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.910596:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.910600:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.910610:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.910631:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.910638:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.910647:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788390503.911182:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.911189:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911198:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.911201:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.911206:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911217:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911227:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911235:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911256:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788390503.911675:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.911681:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911690:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.911693:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.911697:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911706:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911714:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911721:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.911729:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788390503.912265:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.912272:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912281:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.912290:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.912295:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912305:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912314:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912321:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912329:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788390503.912857:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.912864:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912873:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.912876:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.912881:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912891:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912899:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912912:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.912923:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788390503.913389:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.913395:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.913404:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.913407:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.913411:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.913421:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.913428:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.913435:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.913515:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1788390503.917089:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788390503.917102:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917121:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917126:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917138:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917160:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917168:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd32fae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917188:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788390503.917192:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917197:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917201:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917209:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917219:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917232:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd32fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917244:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788390503.917248:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917255:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917259:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917267:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917279:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917287:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd32fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917301:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788390503.917305:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917311:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917321:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917329:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917341:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917350:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd32fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917367:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788390503.917371:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917378:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917382:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917394:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917405:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917414:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd32fca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917482:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788390503.917488:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917495:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917500:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917508:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917519:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917527:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009942e9c8/0x9aafc5f04cd32fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917539:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788390503.917543:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917549:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917553:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917573:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917583:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917590:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c00f80bc/0x9aafc5f04cd32fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917603:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788390503.917607:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917614:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917618:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917626:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917636:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917642:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a347de4/0x9aafc5f04cd32fdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917668:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390503.917672:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917679:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917682:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917689:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917699:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917706:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd32fe6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917718:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390503.917722:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917728:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31cc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390503.917731:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.917749:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918307:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918320:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd32fed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918336:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390503.918338:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390503.918340:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390503.918390:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390503.918393:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390503.918395:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.918609:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.918616:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918628:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.918632:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.918639:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918652:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918672:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918680:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.918710:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390503.918807:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390503.918815:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.918890:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.918895:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.918905:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.918920:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.918939:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe8bf109/0x9aafc5f04cd32ff4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.918955:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.918957:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.918975:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.919573:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.919580:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.919589:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.919593:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.919597:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.919608:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.919616:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.919624:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.919724:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390503.919787:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390503.919794:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.919803:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.919807:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.919816:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.919893:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.919901:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd32ffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.919916:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.919918:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.919919:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.920431:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.920625:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.920637:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.920642:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.920646:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.920656:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.920665:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.920672:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.921674:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.922894:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.922905:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.922922:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.922933:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.922939:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.922954:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.922983:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.922990:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.924313:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390503.924320:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.924328:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.924331:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.924339:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.924357:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.924365:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33002 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.925194:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.925923:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.925931:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.925943:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.925947:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.925953:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.926190:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.926199:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.926212:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.926245:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788390503.927010:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.927017:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927026:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.927030:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.927201:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927215:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927224:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927232:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927242:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788390503.927783:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.927789:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927803:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.927806:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.927810:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927819:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927826:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927833:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.927840:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788390503.928338:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.928344:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.928352:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.928356:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.928360:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.928369:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.928386:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.928394:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.928403:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788390503.929824:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788390503.929923:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.929936:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31dc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.929942:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.929953:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930312:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930317:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003155b586/0x9aafc5f04cd33009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930331:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788390503.930333:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930337:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.930339:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930344:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930349:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930353:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022ad3b85/0x9aafc5f04cd33010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930359:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390503.930362:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930369:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.930371:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930375:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930381:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930384:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000020e1b14/0x9aafc5f04cd33017 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930391:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390503.930393:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930396:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.930398:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930402:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930411:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930422:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d10094/0x9aafc5f04cd3301e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930434:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390503.930437:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930444:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.930447:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930454:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930464:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930471:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053900f75/0x9aafc5f04cd33025 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.930483:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.930485:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.930487:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.932620:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.932632:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.932650:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.932655:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.932662:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.932677:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.932686:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.932694:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.932721:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.933719:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.933726:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.933737:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.933740:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.933744:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.933755:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.933775:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.933783:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.933794:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788390503.934288:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.934292:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.934299:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.934305:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.934308:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.934315:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.934320:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.934325:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.934330:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788390503.934649:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390503.934656:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935301:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31cc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.935306:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935315:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935329:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935334:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a81a38/0x9aafc5f04cd3302c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935349:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390503.935352:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935356:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31da00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.935358:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935362:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935370:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935383:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d4efeef/0x9aafc5f04cd33033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935396:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390503.935399:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935406:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390503.935409:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935415:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935422:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935427:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008228827d/0x9aafc5f04cd3303a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390503.935434:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.935436:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390503.935438:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.936418:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.936428:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.936495:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.936500:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.936505:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.936521:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.936531:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.936547:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.936564:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.937161:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.937168:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.937178:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.937181:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.937186:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.937197:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.937205:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.937213:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.937223:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788390503.938036:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.938043:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.938060:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.938064:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.938068:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.938080:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.938088:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.938097:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.938106:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000001:00100000:2.0:1788390503.939397:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788390503.939515:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788390503.939523:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939535:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.939541:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939551:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939575:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939584:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d44ae0/0x9aafc5f04cd33041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939606:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390503.939611:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939632:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ce00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.939770:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939781:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939794:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939802:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0bb1176/0x9aafc5f04cd33048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939819:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390503.939823:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939829:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.939832:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939840:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939850:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939865:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcfa48f2/0x9aafc5f04cd3304f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.939880:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.939883:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.939885:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.940007:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.940015:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940026:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.940030:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.940037:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940048:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940067:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940075:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940094:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390503.940490:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.940497:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940505:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.940508:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.940513:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940522:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940530:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940538:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.940557:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788390503.940947:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390503.940955:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.940986:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.940990:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.940999:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941014:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941021:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016b98f56/0x9aafc5f04cd33056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941040:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390503.941044:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941057:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31de00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.941060:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941067:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941078:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941086:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4bef0fc/0x9aafc5f04cd3305d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941099:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.941100:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.941102:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.941352:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.941357:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.941366:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.941368:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.941372:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.941380:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.941387:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.941395:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.941416:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390503.941820:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390503.941827:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941835:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.941839:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941847:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941866:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941873:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c17ed6/0x9aafc5f04cd33064 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.941888:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.941890:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.941892:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390503.942235:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788390503.942242:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.942252:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788390503.942262:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390503.942267:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.942278:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.942286:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.942294:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390503.942309:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788390503.942552:0:15043:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:2.0:1788390503.942735:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390503.942742:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.942750:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390503.942754:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.942775:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.942789:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.942796:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac05e29d/0x9aafc5f04cd3306b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390503.942822:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.942824:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.942826:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390503.942942:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14379:x1875263103263232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 48015us (48877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390503.942953:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788390503.943984:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390503.944554:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875263103263232:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788390503.944571:0:14379:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788390503.944614:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875263103263360:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788390503.944730:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390503.944774:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390503.944787:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263360 00000100:00100000:0.0:1788390503.944795:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263360 00000100:00100000:0.0:1788390503.944851:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390503.944863:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14379:x1875263103263360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788390503.944905:0:15042:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788390503.952204:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1875263103263360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7334us (7465us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788390503.952219:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390503.952291:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875263103263360:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788390503.952316:0:14379:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1788390503.985848:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788390504.525203:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390504.588890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.588996:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837184 00000100:00100000:2.0:1788390504.589006:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837184 00000100:00100000:2.0:1788390504.589085:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788390504.589094:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1875263093837184:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788390504.589129:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1788390504.589156:0:14347:0:(genops.c:1385:class_connect()) connect: client d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed, cookie 0x9aafc5f04cd33072 00000100:00080000:2.0:1788390504.589281:0:14347:0:(import.c:65:import_set_state_nolock()) ffff95d5810cd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390504.589347:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+5:2355:x1875263093837184:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 253us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.589354:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788390504.593086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.593207:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837312 00000100:00100000:0.0:1788390504.593217:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837312 00000100:00100000:0.0:1788390504.593269:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1788390504.593333:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+5:13753:x1875263093837312:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390504.593349:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390504.593364:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31ce00/0x9aafc5f04cd33079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee82 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.593386:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31ce00/0x9aafc5f04cd33079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee82 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.593393:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31ce00/0x9aafc5f04cd33079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee82 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.593400:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31ce00, rc 0) 00000100:00100000:0.0:1788390504.595438:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+6:13753:x1875263093837312:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 2094us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.595452:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788390504.600322:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.600556:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837440 00000100:00100000:2.0:1788390504.600566:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837440 00000100:00100000:2.0:1788390504.600634:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788390504.600646:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+6:13753:x1875263093837440:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390504.601093:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+6:13753:x1875263093837440:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 447us (779us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390504.601108:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788390504.606440:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.606562:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837568 00000100:00100000:0.0:1788390504.606573:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837568 00000100:00100000:0.0:1788390504.606664:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788390504.606676:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+6:13753:x1875263093837568:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390504.606694:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390504.606726:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31d200/0x9aafc5f04cd33080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfee89 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.606886:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31d200/0x9aafc5f04cd33080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee89 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.606900:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31d200/0x9aafc5f04cd33080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfee89 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.606910:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d200, rc 0) 00000100:00100000:0.0:1788390504.607024:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+7:13753:x1875263093837568:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 349us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.607032:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788390504.609895:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.610017:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837696 00000100:00100000:2.0:1788390504.610033:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837696 00000100:00100000:2.0:1788390504.610100:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788390504.610111:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+7:13753:x1875263093837696:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390504.610423:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13753:x1875263093837696:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 312us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.610431:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390504.614111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.614319:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837824 00000100:00100000:0.0:1788390504.614334:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837824 00000100:00100000:0.0:1788390504.614412:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788390504.614425:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13753:x1875263093837824:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390504.614714:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13753:x1875263093837824:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 290us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.614724:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1788390504.618229:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.618358:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093837952 00000100:00100000:0.0:1788390504.618371:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093837952 00000100:00100000:0.0:1788390504.618436:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788390504.618445:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13771:x1875263093837952:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390504.618778:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13771:x1875263093837952:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 332us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.618792:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788390504.627856:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.627943:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838080 00000100:00100000:2.0:1788390504.627958:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838080 00000100:00100000:2.0:1788390504.628591:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1788390504.628605:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13771:x1875263093838080:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390504.629039:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13771:x1875263093838080:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 435us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.629051:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390504.636018:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.636468:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838208 00000100:00100000:0.0:1788390504.636480:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838208 00000100:00100000:0.0:1788390504.636566:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788390504.636579:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+8:13753:x1875263093838208:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390504.636602:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390504.636626:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31d000/0x9aafc5f04cd33087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeeb3 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.636661:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31d000/0x9aafc5f04cd33087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeb3 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.636672:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31d000/0x9aafc5f04cd33087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeb3 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390504.636683:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d000, rc 0) 00000100:00100000:0.0:1788390504.636767:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+9:13753:x1875263093838208:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 190us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.636776:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788390504.640058:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.640173:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838336 00000100:00100000:2.0:1788390504.640184:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838336 00000100:00100000:2.0:1788390504.640233:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390504.640242:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+9:13753:x1875263093838336:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788390504.640274:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788390504.640307:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788390504.640312:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788390504.640315:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788390504.640318:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788390504.643918:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+9:13753:x1875263093838336:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 3659us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.643940:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390504.646386:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.646485:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838464 00000100:00100000:2.0:1788390504.646499:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838464 00000100:00100000:2.0:1788390504.646614:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1788390504.646626:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+9:13753:x1875263093838464:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788390504.646648:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390504.646671:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeeba expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.646706:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.646719:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.646730:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:2.0:1788390504.646803:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13753:x1875263093838464:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 179us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.646810:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788390504.649685:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.649913:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838592 00000100:00100000:0.0:1788390504.649926:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838592 00000100:00100000:0.0:1788390504.650026:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788390504.650040:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13753:x1875263093838592:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390504.650608:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13753:x1875263093838592:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 570us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.650617:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788390504.655943:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.660461:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838720 00000100:00100000:2.0:1788390504.660483:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838720 00000100:00100000:3.0:1788390504.662910:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390504.662929:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13753:x1875263093838720:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788390504.663488:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13753:x1875263093838720:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 561us (7555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390504.663499:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390504.666666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.666814:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838848 00000100:00100000:0.0:1788390504.666828:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838848 00000100:00100000:0.0:1788390504.667082:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1788390504.667114:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13775:x1875263093838848:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390504.667411:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13775:x1875263093838848:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 302us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.667421:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788390504.670560:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390504.670640:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093838976 00000100:00100000:3.0:1788390504.670653:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093838976 00000100:00100000:3.0:1788390504.670782:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390504.670796:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13775:x1875263093838976:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390504.671163:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13775:x1875263093838976:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 370us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390504.671173:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390504.682912:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.683275:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839104 00000100:00100000:2.0:1788390504.683290:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839104 00000100:00100000:2.0:1788390504.683351:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390504.683362:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263093839104:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788390504.683421:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1788390504.683499:0:14354:0:(genops.c:1385:class_connect()) connect: client c81d4476-fbab-45da-be95-db71a881e268, cookie 0x9aafc5f04cd33095 00000004:00100000:2.0:1788390504.683536:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788390504.683543:0:14354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788390504.713215:0:14354:0:(import.c:65:import_set_state_nolock()) ffff95d68f2cd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390504.713372:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2355:x1875263093839104:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 30008us (30474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.713385:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390504.719633:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.719685:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390504.719781:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839232 00000100:00100000:1.0:1788390504.719796:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839232 00000100:00080000:2.0:1788390504.719927:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390504.720074:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839360 00000100:00100000:1.0:1788390504.720079:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839360 00000100:00100000:3.0:1788390504.720213:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788390504.720293:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+7:0:x1875263093839232:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788390504.720353:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788390504.722237:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+7:0:x1875263093839232:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 2005us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.722253:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788390504.722298:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390504.722312:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839360:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788390504.722343:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788390504.722367:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839360:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 63us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.722372:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390504.724063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390504.724203:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839488 00000100:00100000:0.0:1788390504.724218:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839488 00000100:00100000:0.0:1788390504.724287:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390504.724296:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839488:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788390504.724369:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839488:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.724376:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390504.728687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390504.728733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390504.728784:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390504.728895:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839872 00000100:00100000:1.0:1788390504.728911:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839872 00000100:00100000:1.0:1788390504.729024:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390504.729039:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839872:12345-192.168.202.1@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788390504.729203:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839616 00000100:00100000:0.0:1788390504.729208:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839616 00000100:00100000:0.0:1788390504.729240:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093839744 00000100:00100000:0.0:1788390504.729244:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093839744 00000100:00100000:0.0:1788390504.729259:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390504.729264:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263093839616:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788390504.729289:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1788390504.729322:0:15043:0:(genops.c:1385:class_connect()) connect: client c81d4476-fbab-45da-be95-db71a881e268, cookie 0x9aafc5f04cd3309c 00002000:00100000:0.0:1788390504.729335:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c81d4476-fbab-45da-be95-db71a881e268/ffff95d68f2c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390504.729362:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00080000:1.0:1788390504.730497:0:14357:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1386us 00002000:00080000:0.0:1788390504.731036:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390504.731083:0:15043:0:(import.c:65:import_set_state_nolock()) ffff95d68f2c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390504.731166:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2355:x1875263093839616:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 1898us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.731178:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390504.731204:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390504.731210:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263093839744:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788390504.731232:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1788390504.731259:0:15043:0:(genops.c:1385:class_connect()) connect: client c81d4476-fbab-45da-be95-db71a881e268, cookie 0x9aafc5f04cd330a3 00002000:00100000:0.0:1788390504.731272:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c81d4476-fbab-45da-be95-db71a881e268/ffff95d68f2cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390504.731282:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390504.731443:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390504.731462:0:15043:0:(import.c:65:import_set_state_nolock()) ffff95d68f2cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390504.731490:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2355:x1875263093839744:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 278us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390504.731498:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000004:00200000:3.0:1788390504.742748:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788390504.742939:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+6:13753:x1875263093839872:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 13899us (14199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390504.742954:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390504.871141:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390504.871334:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840000 00000100:00100000:2.0:1788390504.871348:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840000 00000100:00100000:2.0:1788390504.871475:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788390504.871485:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+6:13796:x1875263093840000:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:2.0:1788390504.871510:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390504.871552:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd330aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeee4 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871634:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871652:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871681:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390504.871725:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390504.871728:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390504.871777:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871809:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd330aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeee4 expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871830:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeee4 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390504.871841:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:2.0:1788390504.871845:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390504.871853:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:2.0:1788390504.872227:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+7:13796:x1875263093840000:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 740us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390504.872238:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:3.0:1788390505.549234:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390506.445322:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103263488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390506.445415:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390506.445580:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263488 00000100:00100000:2.0:1788390506.445608:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263488 00000100:00100000:2.0:1788390506.445735:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390506.445755:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103263488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390506.445808:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390506.445889:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103263488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.445895:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390506.446445:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103263488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390506.452547:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390506.464138:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390506.464362:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840128 00000100:00100000:3.0:1788390506.464374:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840128 00000100:00080000:2.0:1788390506.464428:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390506.464462:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390506.464473:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c81d4476-fbab-45da-be95-db71a881e268+6:13848:x1875263093840128:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1788390506.464511:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390506.464605:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c81d4476-fbab-45da-be95-db71a881e268+6:13848:x1875263093840128:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 133us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390506.464614:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390506.466083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390506.466337:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840256 00000100:00100000:3.0:1788390506.466349:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840256 00000100:00080000:2.0:1788390506.466424:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390506.466465:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390506.466476:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c81d4476-fbab-45da-be95-db71a881e268+6:13848:x1875263093840256:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1788390506.466528:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390506.466631:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c81d4476-fbab-45da-be95-db71a881e268+6:13848:x1875263093840256:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 156us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390506.466649:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00010000:00010000:0.0:1788390506.573200:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390506.589716:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.589907:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840384 00000100:00100000:0.0:1788390506.589926:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840384 00000100:00100000:0.0:1788390506.590038:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788390506.590049:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+10:13881:x1875263093840384:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390506.590064:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390506.590092:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31da00/0x9aafc5f04cd330b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeeeb expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.590115:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31da00/0x9aafc5f04cd330b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeeb expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.590123:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31da00/0x9aafc5f04cd330b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeeb expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.590130:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31da00, rc 0) 00000100:00100000:0.0:1788390506.590193:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093840384:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 145us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.590200:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788390506.593327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.593466:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840512 00000100:00100000:0.0:1788390506.593479:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840512 00000100:00100000:0.0:1788390506.593612:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788390506.593626:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093840512:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390506.594041:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093840512:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 418us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.594051:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390506.598696:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.600675:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840640 00000100:00100000:0.0:1788390506.600699:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840640 00000100:00100000:0.0:1788390506.600807:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788390506.600820:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093840640:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390506.601203:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093840640:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 383us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.601213:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1788390506.604840:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.604995:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840768 00000100:00100000:0.0:1788390506.605009:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840768 00000100:00100000:0.0:1788390506.605086:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788390506.605099:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13887:x1875263093840768:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390506.605587:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13887:x1875263093840768:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 489us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.605597:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:2.0:1788390506.623498:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.623763:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093840896 00000100:00100000:1.0:1788390506.623777:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093840896 00000100:00100000:1.0:1788390506.623842:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788390506.623855:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13887:x1875263093840896:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390506.625176:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13887:x1875263093840896:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 1312us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390506.625191:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788390506.638895:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.639029:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841024 00000100:00100000:0.0:1788390506.639043:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841024 00000100:00100000:0.0:1788390506.639563:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788390506.639578:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13881:x1875263093841024:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390506.639602:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390506.639626:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31cc00/0x9aafc5f04cd330bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef15 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.639665:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31cc00/0x9aafc5f04cd330bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef15 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.639679:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31cc00/0x9aafc5f04cd330bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef15 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.639691:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31cc00, rc 0) 00000100:00100000:0.0:1788390506.639793:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13881:x1875263093841024:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 218us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.639801:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788390506.641881:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.641981:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841152 00000100:00100000:1.0:1788390506.641992:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841152 00000100:00100000:1.0:1788390506.642045:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788390506.642054:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13881:x1875263093841152:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788390506.642083:0:14348:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788390506.642139:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390506.642142:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788390506.642145:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788390506.642147:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788390506.643873:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13881:x1875263093841152:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1810us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.643897:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1788390506.647270:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.647376:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841280 00000100:00100000:0.0:1788390506.647391:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841280 00000100:00100000:0.0:1788390506.647457:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1788390506.647467:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13881:x1875263093841280:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390506.647486:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390506.647507:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef1c expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.647537:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.647546:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.647554:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c400, rc 0) 00000100:00100000:0.0:1788390506.647620:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13881:x1875263093841280:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 155us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.647625:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788390506.649607:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.649830:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841408 00000100:00100000:0.0:1788390506.649842:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841408 00000100:00100000:0.0:1788390506.649943:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788390506.649954:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13881:x1875263093841408:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390506.650373:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13881:x1875263093841408:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 419us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.650382:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:1.0:1788390506.651834:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390506.651893:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841536 00000100:00100000:2.0:1788390506.651903:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841536 00000100:00100000:2.0:1788390506.651949:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788390506.651958:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13881:x1875263093841536:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390506.652201:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13881:x1875263093841536:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 238us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.652209:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788390506.654371:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.654456:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841664 00000100:00100000:0.0:1788390506.654465:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841664 00000100:00100000:0.0:1788390506.654512:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788390506.654520:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13890:x1875263093841664:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390506.654762:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13890:x1875263093841664:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 243us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.654768:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1788390506.659335:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390506.659417:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841792 00000100:00100000:2.0:1788390506.659429:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841792 00000100:00100000:2.0:1788390506.659488:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788390506.659501:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13890:x1875263093841792:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390506.659861:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13890:x1875263093841792:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 361us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.659880:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1788390506.666074:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.666126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.666160:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.666194:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.666234:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842560 00000100:00100000:1.0:1788390506.666247:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842560 00000100:00100000:1.0:1788390506.666305:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842432 00000100:00100000:1.0:1788390506.666308:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842432 00000100:00100000:1.0:1788390506.666324:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788390506.666335:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093842560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390506.666366:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093841920 00000100:00100000:0.0:1788390506.666373:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093841920 00000100:00100000:0.0:1788390506.666401:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842304 00000100:00100000:0.0:1788390506.666405:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842304 00000100:00100000:1.0:1788390506.666435:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093842560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390506.666448:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390506.666448:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390506.666463:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2358:x1875263093842304:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390506.666475:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788390506.666484:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093842432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390506.666506:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2358:x1875263093842304:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.666516:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390506.666520:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093842432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390506.666528:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390506.666536:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390506.666543:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263093841920:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788390506.666571:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fca61cce-adf5-4b9d-82ab-6877bfc57d88@192.168.202.1@tcp t0 exp 0000000000000000 cur 323 last 0 00000100:00080000:1.0:1788390506.666665:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788390506.667368:0:14354:0:(genops.c:1385:class_connect()) connect: client fca61cce-adf5-4b9d-82ab-6877bfc57d88, cookie 0x9aafc5f04cd330cd 00000004:00100000:0.0:1788390506.667414:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788390506.667594:0:14354:0:(import.c:65:import_set_state_nolock()) ffff95d68f2ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390506.667666:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2355:x1875263093841920:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 1120us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.667676:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390506.669506:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390506.669807:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842048 00000100:00100000:2.0:1788390506.669820:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842048 00000100:00100000:2.0:1788390506.669950:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390506.670010:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:0:x1875263093842048:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788390506.670069:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788390506.670145:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:0:x1875263093842048:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 184us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.670152:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00080000:1.0:1788390506.671516:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390506.673680:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.673889:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842176 00000100:00100000:0.0:1788390506.673910:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842176 00000100:00100000:2.0:1788390506.674481:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788390506.674500:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093842176:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788390506.674548:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788390506.674658:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093842176:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 165us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.674667:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390506.678858:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390506.679042:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842688 00000100:00100000:3.0:1788390506.679055:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842688 00000100:00100000:3.0:1788390506.679158:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390506.679171:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093842688:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788390506.679288:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093842688:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 120us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390506.679296:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390506.682408:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.682495:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390506.682535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.682657:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842816 00000100:00100000:0.0:1788390506.682670:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842816 00000100:00100000:0.0:1788390506.682732:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093842944 00000100:00100000:0.0:1788390506.682743:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093842944 00000100:00100000:2.0:1788390506.682782:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788390506.682804:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093842816:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390506.682847:0:15040:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fca61cce-adf5-4b9d-82ab-6877bfc57d88@192.168.202.1@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788390506.682889:0:15040:0:(genops.c:1385:class_connect()) connect: client fca61cce-adf5-4b9d-82ab-6877bfc57d88, cookie 0x9aafc5f04cd330d4 00002000:00100000:2.0:1788390506.682905:0:15040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fca61cce-adf5-4b9d-82ab-6877bfc57d88/ffff95d5810cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788390506.682913:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843072 00000100:00100000:3.0:1788390506.682920:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843072 00002000:00100000:2.0:1788390506.682920:0:15040:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788390506.682994:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788390506.683005:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093843072:12345-192.168.202.1@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788390506.683087:0:15040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00200000:3.0:1788390506.683095:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00080000:2.0:1788390506.683125:0:15040:0:(import.c:65:import_set_state_nolock()) ffff95d5810c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390506.683304:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13881:x1875263093843072:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 301us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390506.683316:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788390506.683319:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2355:x1875263093842816:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 512us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.683414:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788390506.683437:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390506.683442:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093842944:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390506.683458:0:15040:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fca61cce-adf5-4b9d-82ab-6877bfc57d88@192.168.202.1@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788390506.683479:0:15040:0:(genops.c:1385:class_connect()) connect: client fca61cce-adf5-4b9d-82ab-6877bfc57d88, cookie 0x9aafc5f04cd330db 00002000:00100000:2.0:1788390506.683485:0:15040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fca61cce-adf5-4b9d-82ab-6877bfc57d88/ffff95d5810c9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390506.683492:0:15040:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788390506.687469:0:15040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788390506.687537:0:15040:0:(import.c:65:import_set_state_nolock()) ffff95d5810ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390506.687636:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2355:x1875263093842944:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 4187us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390506.687650:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390506.816317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390506.816471:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843200 00000100:00100000:0.0:1788390506.816481:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843200 00000100:00100000:0.0:1788390506.816545:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390506.816556:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:13911:x1875263093843200:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1788390506.816576:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390506.816599:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd330e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef46 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.816790:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.816804:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.816816:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390506.816856:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390506.816860:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390506.816882:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.816912:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd330e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.816952:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390506.817049:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:0.0:1788390506.817052:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390506.817056:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c600, rc 0) 00000100:00100000:0.0:1788390506.817120:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+7:13911:x1875263093843200:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 566us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390506.817128:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:1.0:1788390507.597080:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390508.624893:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390508.626670:0:16313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788390509.005344:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103263744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.005366:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103263872:0@lo:400:kworker.0 00000100:00100000:0.0:1788390509.005451:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788390509.005463:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103263616:0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.007018:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390509.007082:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103264384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390509.007112:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390509.007127:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390509.007133:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103264256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.007151:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390509.007180:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263872 00000100:00100000:1.0:1788390509.007187:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263872 00000100:00100000:1.0:1788390509.007236:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390509.007244:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103263872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.007285:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103263872:12345-0@lo:400:kworker.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390509.007292:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390509.007313:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264384 00000100:00100000:1.0:1788390509.007316:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264384 00000100:00100000:1.0:1788390509.007335:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390509.007340:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103264384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390509.007364:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390509.007390:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103264384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390509.007396:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788390509.007421:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390509.007451:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103264384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390509.007460:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103263872:0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.007508:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264256 00000100:00100000:1.0:1788390509.007511:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264256 00000100:00100000:1.0:1788390509.007535:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390509.007541:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103264256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.007569:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103264256:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390509.007574:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788390509.007584:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390509.008125:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103264256:0@lo:400:kworker.0 00000100:00100000:2.0:1788390509.008773:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390509.008812:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263744 00000100:00100000:2.0:1788390509.008817:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263744 00000100:00100000:2.0:1788390509.008860:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390509.008869:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103263744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390509.008930:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103263744:12345-0@lo:400:kworker.0 Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390509.008937:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788390509.008956:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390509.008995:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103263744:0@lo:400:kworker.0 00000100:00100000:0.0:1788390509.009947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390509.010024:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264000 00000100:00100000:0.0:1788390509.010030:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264000 00000100:00100000:0.0:1788390509.010066:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390509.010073:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103264000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390509.010114:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103264000:12345-0@lo:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390509.010118:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390509.010144:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788390509.012939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390509.013009:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103264128:0@lo:400:kworker.0 00000100:00100000:3.0:1788390509.013050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390509.013100:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264128 00000100:00100000:3.0:1788390509.013108:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264128 00000100:00100000:3.0:1788390509.013164:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390509.013611:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103264128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390509.013672:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103264128:12345-0@lo:400:kworker.0 Request processed in 499us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390509.013679:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788390509.013729:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390509.013758:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103264128:0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.015489:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103263616 00000100:00100000:1.0:1788390509.015501:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103263616 00000100:00100000:1.0:1788390509.015563:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788390509.015574:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103263616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390509.015652:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103263616:12345-0@lo:400:kworker.0 Request processed in 80us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390509.015661:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390509.021033:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103263616:0@lo:400:kworker.0 00000001:00100000:0.0:1788390509.085343:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c81d4476-fbab-45da-be95-db71a881e268 00000001:00080000:0.0:1788390509.085360:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788390509.085400:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000001:00100000:3.0:1788390509.555758:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c81d4476-fbab-45da-be95-db71a881e268 00000001:00100000:3.0:1788390509.555775:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fca61cce-adf5-4b9d-82ab-6877bfc57d88 00010000:00010000:1.0:1788390509.648344:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788390510.047464:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000001:00100000:2.0:1788390510.047480:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c81d4476-fbab-45da-be95-db71a881e268 00010000:00010000:0.0:1788390510.669303:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390511.341002:0:16464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff693539e0 20000000:00000080:0.0:1788390511.341028:0:16464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d5860d2000 uarg=0000000000000000 20000000:01000000:0.0:1788390511.341078:0:16464:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390511.341085:0:16464:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390511.341092:0:16464:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788390511.343902:0:16465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788390511.345215:0:16464:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788390511.351393:0:16464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788390511.351570:0:16464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351595:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351603:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351625:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351637:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351645:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351653:0:16464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351725:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351741:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.351761:0:16464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264512:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390511.351938:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.351948:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.351957:0:16464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264640:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390511.352010:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.352030:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.352041:0:16464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264768:0@lo:104: 00000100:00100000:1.0:1788390511.352093:0:16464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390511.352141:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.352150:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 18 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.352159:0:16464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264896:0@lo:104: 00000100:00100000:1.0:1788390511.352178:0:16464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390511.352222:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.352230:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 18 pid: 14347 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.352238:0:16464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103265024:0@lo:104: 00000100:00100000:1.0:1788390511.352266:0:16464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390511.352276:0:16464:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390511.352370:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788390511.352388:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264768 00000100:00100000:3.0:1788390511.352397:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264768 00000100:00100000:3.0:1788390511.352447:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103264896 00000100:00100000:3.0:1788390511.352449:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103264896 00000100:00100000:3.0:1788390511.352459:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265024 00000100:00100000:3.0:1788390511.352461:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265024 00000100:00100000:3.0:1788390511.352474:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390511.352485:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+5:16464:x1875263103264768:12345-0@lo:104: 00010000:00010000:3.0:1788390511.352499:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352571:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390511.352577:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+5:16464:x1875263103264768:12345-0@lo:104: Request processed in 95us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.352585:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390511.352607:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390511.352612:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+4:16464:x1875263103264896:12345-0@lo:104: 00010000:00010000:3.0:1788390511.352620:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352653:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390511.352658:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+4:16464:x1875263103264896:12345-0@lo:104: Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.352672:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390511.352685:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390511.352701:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+3:16464:x1875263103265024:12345-0@lo:104: 00010000:00010000:3.0:1788390511.352710:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352738:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788390511.352743:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6ebd9ca6-c84c-470c-bc70-726259965b52+3:16464:x1875263103265024:12345-0@lo:104: Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.352748:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788390511.352787:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390511.352794:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352802:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390511.352807:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352817:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390511.352825:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390511.352832:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390511.352865:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352872:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390511.352899:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352906:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd32f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32f68 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352921:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390511.352924:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352930:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390511.352933:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.352940:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390511.352945:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390511.352951:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390511.352994:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353001:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390511.353007:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353013:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd32e2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32e34 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353034:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390511.353037:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353042:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390511.353045:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353051:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390511.353057:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390511.353062:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390511.353075:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353081:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390511.353105:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353112:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b64faa00/0x9aafc5f04cd32de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd32de7 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353124:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390511.353126:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390511.353127:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390511.353134:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390511.353162:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103265152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390511.353196:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390511.353221:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390511.353226:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103265280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390511.353246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390511.353273:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103265408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390511.353299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390511.353334:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265152 00000100:00100000:3.0:1788390511.353338:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265152 00010000:00010000:3.0:1788390511.353360:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 19 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390511.353376:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265280 00000100:00100000:3.0:1788390511.353379:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265280 00010000:00010000:3.0:1788390511.353390:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 20 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390511.353399:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265408 00000100:00100000:3.0:1788390511.353401:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265408 00010000:00010000:3.0:1788390511.353411:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 21 pid: 14347 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390511.353424:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390511.353430:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+21:3286:x1875263103265152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390511.353442:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390511.353448:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 21 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353458:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 21 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353484:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390511.353513:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+21:3286:x1875263103265152:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.353519:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390511.353534:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390511.353540:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+20:3286:x1875263103265280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390511.353548:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390511.353552:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 20 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353560:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 20 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353570:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390511.353591:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+20:3286:x1875263103265280:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.353597:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390511.353608:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390511.353614:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103265408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390511.353621:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390511.353624:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 19 pid: 14347 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353632:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 19 pid: 14347 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.353640:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390511.353671:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103265408:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.353676:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390511.353759:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103265408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390511.353786:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103265280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390511.353794:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103265152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390511.353889:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63200/0x9aafc5f04cd32f68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32f61 expref: 18 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.353900:0:16464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264768:0@lo:104: 00010000:00010000:1.0:1788390511.353910:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd32e34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32e2d expref: 17 pid: 14348 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.353929:0:16464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264896:0@lo:104: 00010000:00010000:1.0:1788390511.353941:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62a00/0x9aafc5f04cd32de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd32de0 expref: 16 pid: 14347 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.353949:0:16464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103265024:0@lo:104: 00000100:00100000:0.0:1788390511.357772:0:16464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264512:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390511.357793:0:16464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875263103264640:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390511.357838:0:16464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.358631:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390511.358814:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843328 00000100:00100000:3.0:1788390511.358825:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843328 00010000:00010000:3.0:1788390511.358876:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390511.360661:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390511.360685:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093843328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390511.360726:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390511.360737:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.360755:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.360779:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d68f31c400/0x9aafc5f04cd330c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef1c expref: 13 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390511.360798:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390511.360868:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:2357:x1875263093843328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.360874:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390511.361111:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390511.361415:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843456 00000100:00100000:1.0:1788390511.361425:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843456 00010000:00010000:1.0:1788390511.361462:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390511.361483:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788390511.361490:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:2357:x1875263093843456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390511.361500:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390511.361506:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361517:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361529:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd3308e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeeba expref: 12 pid: 14349 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361543:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361553:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361579:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361587:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361593:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361599:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361605:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390511.361610:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361619:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361643:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390511.361656:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390511.361871:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:2357:x1875263093843456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 378us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390511.361880:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:0.0:1788390511.362204:0:16464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390511.362215:0:16464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390511.362221:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd330f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390511.565739:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390511.565770:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103265536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390511.565882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390511.566233:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265536 00000100:00100000:1.0:1788390511.566243:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265536 00000100:00100000:1.0:1788390511.566337:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390511.566349:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103265536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390511.566408:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390511.566460:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103265536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390511.566468:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390511.566620:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103265536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390511.566667:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390511.697520:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390511.735391:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735431:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735469:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735481:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735492:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390511.735536:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843968 00000100:00100000:2.0:1788390511.735548:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843968 00000100:00100000:2.0:1788390511.735624:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844224 00000100:00100000:2.0:1788390511.735628:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844224 00000100:00100000:2.0:1788390511.735641:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843840 00000100:00100000:2.0:1788390511.735643:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843840 00000100:00100000:2.0:1788390511.735649:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844352 00000100:00100000:2.0:1788390511.735650:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844352 00000100:00100000:2.0:1788390511.735666:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390511.735675:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093843968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390511.735786:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843712 00000100:00100000:1.0:1788390511.735790:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843712 00000100:00100000:1.0:1788390511.736314:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844096 00000100:00100000:1.0:1788390511.736320:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844096 00000100:00100000:1.0:1788390511.736342:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390511.736348:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093843712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390511.736436:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093843712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 88us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390511.736442:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390511.736457:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390511.736461:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093844096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390511.736476:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093844096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390511.736480:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390511.736496:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788390511.736503:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788390511.737782:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093843968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1145us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390511.737801:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390511.738294:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390511.738310:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2356:x1875263093844224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390511.738377:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2356:x1875263093844224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.738383:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390511.738409:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788390511.738417:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093843840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390511.738442:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093843840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.738448:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788390511.738459:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390511.738467:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2356:x1875263093844352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390511.738491:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2356:x1875263093844352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.738496:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390511.738521:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093843584 00000100:00100000:3.0:1788390511.738531:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093843584 00000100:00100000:3.0:1788390511.738569:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788390511.738573:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:2356:x1875263093843584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390511.738593:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:2356:x1875263093843584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390511.738599:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00080000:3.0:1788390511.738640:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390511.738648:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390511.738656:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788390512.014222:0:14385:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390512.014237:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390512.015110:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788390512.015394:0:14385:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390512.015449:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1788390512.717450:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390512.824027:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390512.824292:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844480 00000100:00100000:3.0:1788390512.824307:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844480 00000100:00100000:3.0:1788390512.824386:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:3.0:1788390512.824398:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+11:13768:x1875263093844480:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390512.824421:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390512.824447:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd330f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef4d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390512.824483:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd330f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef4d expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390512.824495:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd330f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef4d expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390512.824507:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788390512.824648:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844480:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 252us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390512.824656:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:3.0:1788390512.829498:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390512.829723:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844608 00000100:00100000:1.0:1788390512.829737:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844608 00000100:00100000:1.0:1788390512.829803:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788390512.829814:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844608:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390512.830195:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844608:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 382us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390512.830210:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788390512.831738:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390512.831800:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844736 00000100:00100000:3.0:1788390512.831813:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844736 00000100:00100000:3.0:1788390512.831868:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390512.831879:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844736:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390512.832168:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844736:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 290us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390512.832179:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390512.850120:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390512.850416:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844864 00000100:00100000:2.0:1788390512.850432:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844864 00000100:00100000:2.0:1788390512.850511:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788390512.850539:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+12:13768:x1875263093844864:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390512.850568:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390512.850592:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd330fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef54 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390512.850630:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd330fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef54 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390512.850642:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd330fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef54 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390512.850654:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:2.0:1788390512.850749:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13768:x1875263093844864:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 213us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390512.850758:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788390512.857216:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390512.857287:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093844992 00000100:00100000:3.0:1788390512.857299:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093844992 00000100:00100000:3.0:1788390512.857361:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788390512.857371:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13768:x1875263093844992:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390512.857844:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13768:x1875263093844992:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 473us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390512.857853:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788390512.873198:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390512.875214:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845120 00000100:00100000:2.0:1788390512.875238:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845120 00000100:00100000:2.0:1788390512.875420:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1788390512.875433:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13768:x1875263093845120:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390512.877027:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:13768:x1875263093845120:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 1580us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390512.877044:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 10000000:01000000:3.0:1788390513.039360:0:14351:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788390513.039372:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d686d4d800 from 10 10000000:01000000:3.0:1788390513.039381:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390513.039456:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.039471:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.039487:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390513.039524:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.039639:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390513.040163:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390513.040197:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265664 00000100:00100000:3.0:1788390513.040208:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265664 00000100:00100000:3.0:1788390513.040268:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390513.040277:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+16:14351:x1875263103265664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390513.040295:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390513.040327:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd3310c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd33105 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.040357:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd3310c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd33105 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.040369:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd3310c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd33105 expref: 17 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.040381:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390513.040429:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103265664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390513.040436:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390513.040486:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390513.040502:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3310c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.040513:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3310c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390513.040725:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.040756:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390513.040790:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390513.040833:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265792 00000100:00100000:0.0:1788390513.040838:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265792 00000100:00100000:0.0:1788390513.040871:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390513.040878:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103265792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390513.041227:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103265792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390513.041234:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390513.044473:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.044560:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.044672:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390513.044744:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390513.044881:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103265920 00000100:00100000:1.0:1788390513.044891:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103265920 00000100:00100000:1.0:1788390513.044987:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788390513.044999:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103265920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390513.045250:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103265920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390513.045259:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390513.046854:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103265920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390513.048303:0:16563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788390513.048515:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390513.048541:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390513.048555:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3310c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.048569:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd33105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3310c expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390513.048658:0:14351:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390513.048662:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d69ef6c800 from 10 10000000:01000000:1.0:1788390513.048666:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390513.048728:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.048739:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.048753:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390513.048809:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390513.048904:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390513.048990:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d5861cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390513.049942:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266048 00000100:00100000:3.0:1788390513.050141:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266048 00000100:00100000:3.0:1788390513.050214:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390513.050227:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+17:14351:x1875263103266048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390513.050247:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390513.050268:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd3311a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd33113 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.050301:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd3311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd33113 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.050315:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd3311a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd33113 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.050326:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:3.0:1788390513.050450:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390513.050458:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390513.053802:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390513.053839:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3311a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390513.053860:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3311a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390513.053956:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390513.054767:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390513.054883:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390513.058950:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266176 00000100:00100000:3.0:1788390513.065730:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266176 00000100:00100000:1.0:1788390513.066848:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788390513.066866:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390513.067310:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (12542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390513.067319:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788390513.067510:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390513.067686:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390513.067747:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390513.067839:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390513.071372:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266304 00000100:00100000:1.0:1788390513.071393:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266304 00000100:00100000:1.0:1788390513.071464:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788390513.071477:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390513.071950:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 474us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390513.071983:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390513.072210:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390513.077269:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788390513.077456:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788390513.077494:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390513.077508:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3311a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.077523:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd33113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3311a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390513.077536:0:14351:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390513.077540:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68527e000 from 10 10000000:01000000:0.0:1788390513.077543:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390513.077595:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.077604:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.077616:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390513.077669:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390513.083994:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390513.084863:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390513.084864:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266432 00000100:00100000:1.0:1788390513.084879:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266432 00000100:00100000:0.0:1788390513.085718:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788390513.085733:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+18:14351:x1875263103266432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390513.085758:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390513.085782:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68f31de00/0x9aafc5f04cd33128 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd33121 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.085822:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68f31de00/0x9aafc5f04cd33128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd33121 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.085836:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68f31de00/0x9aafc5f04cd33128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd33121 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.085848:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31de00, rc 0) 00000100:00100000:0.0:1788390513.085919:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103266432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390513.085926:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788390513.086016:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390513.086038:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33128 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.086050:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd33128 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390513.086149:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390513.086180:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390513.086208:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390513.087792:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266560 00000100:00100000:2.0:1788390513.087809:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266560 00000100:00100000:2.0:1788390513.087873:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788390513.087883:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103266560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390513.088496:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103266560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 612us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390513.088507:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788390513.088594:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.088660:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390513.088728:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390513.088804:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390513.088850:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266688 00000100:00100000:1.0:1788390513.088856:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266688 00000100:00100000:1.0:1788390513.088926:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788390513.088936:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103266688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390513.089240:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:14351:x1875263103266688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390513.089248:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390513.089339:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6ebd9ca6-c84c-470c-bc70-726259965b52:14351:1875263103266688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788390513.090229:0:16567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788390513.090433:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788390513.090454:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390513.090466:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33128 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390513.090481:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d68f31d600/0x9aafc5f04cd33121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33128 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.741426:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390513.950914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390513.951038:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845248 00000100:00100000:1.0:1788390513.951051:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845248 00000100:00080000:3.0:1788390513.951183:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390513.951205:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390513.951218:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+6:14421:x1875263093845248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390513.951249:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390513.951283:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3312f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef5b expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951374:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951392:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951408:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951424:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951431:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951437:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951868:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd33144 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951880:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd33144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.951900:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd33144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390513.951939:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390513.951943:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390513.952047:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd33144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952060:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952067:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952074:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952081:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390513.952086:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952094:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952110:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:1.0:1788390513.952113:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390513.952119:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952126:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952151:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952156:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952163:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952168:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390513.952171:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952177:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952184:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d683b5a400) 00010000:00010000:1.0:1788390513.952187:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390513.952190:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952195:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3313d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952239:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3312f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef5b expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952254:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd33144 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef5b expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390513.952270:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d683b5a000) 00010000:00010000:1.0:1788390513.952272:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390513.952275:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63200, rc 0) 00000100:00100000:1.0:1788390513.952367:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+7:14421:x1875263093845248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1151us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390513.952376:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390513.955090:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390513.965700:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845504 00000100:00100000:0.0:1788390513.965724:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845504 00000100:00100000:0.0:1788390513.965828:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390513.965841:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+7:14421:x1875263093845504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390513.965870:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390513.965898:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3314b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef62 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.966023:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.966041:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.966053:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.967849:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.967874:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.967886:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.968290:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c000/0x9aafc5f04cd33160 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.968300:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c000/0x9aafc5f04cd33160 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.968307:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c000/0x9aafc5f04cd33160 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390513.968319:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788390513.970385:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970404:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970412:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970418:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390513.970422:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970430:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970446:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d683b5a000) 00010000:00010000:0.0:1788390513.970449:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390513.970454:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970480:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33152 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970499:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970506:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970512:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970517:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390513.970520:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970526:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970533:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d684d23b00) 00010000:00010000:0.0:1788390513.970536:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390513.970538:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.970543:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33159 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.974779:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3314b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef62 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.974828:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c000/0x9aafc5f04cd33160 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef62 expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390513.974837:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23900) 00010000:00010000:0.0:1788390513.974840:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390513.974843:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c000, rc 0) 00000100:00100000:0.0:1788390513.974912:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+9:14421:x1875263093845504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 9073us (19835us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788390513.974921:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390513.978619:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390513.978946:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845632 00000100:00100000:2.0:1788390513.980032:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845632 00000100:00100000:2.0:1788390513.980194:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390513.980209:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+9:14421:x1875263093845632:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788390513.980460:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+9:14421:x1875263093845632:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 254us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390513.980489:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390514.013156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.013265:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845760 00000100:00100000:0.0:1788390514.013279:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845760 00000100:00100000:0.0:1788390514.013348:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390514.013358:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+9:14427:x1875263093845760:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390514.013378:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390514.013396:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3316e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef69 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013450:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013460:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013468:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013477:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013505:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013510:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013716:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013723:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013727:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013731:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.013734:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013739:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013748:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:0.0:1788390514.013749:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.013752:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013757:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013765:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013773:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013777:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013779:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.013781:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013784:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013788:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95d684d23b00) 00010000:00010000:0.0:1788390514.013789:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.013790:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013793:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3317c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013816:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3316e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef69 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013822:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:0.0:1788390514.013824:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.013826:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3316e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef69 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.013838:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d800, rc 0) 00000100:00100000:0.0:1788390514.013896:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+9:14427:x1875263093845760:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 540us (757us total) trans 0 rc 301/301 00000100:00100000:0.0:1788390514.013902:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390514.017452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.017578:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093845888 00000100:00100000:1.0:1788390514.017591:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093845888 00000100:00100000:1.0:1788390514.017664:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390514.017685:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c81d4476-fbab-45da-be95-db71a881e268+9:14427:x1875263093845888:12345-192.168.202.1@tcp:700:lfs.0 00000100:00100000:1.0:1788390514.017799:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c81d4476-fbab-45da-be95-db71a881e268+9:14427:x1875263093845888:12345-192.168.202.1@tcp:700:lfs.0 Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.017808:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390514.020897:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390514.021332:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846144 00000100:00100000:2.0:1788390514.021346:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846144 00000100:00100000:2.0:1788390514.021488:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390514.021502:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+9:14427:x1875263093846144:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1788390514.021579:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390514.021615:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd330b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeee4 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390514.021638:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:2.0:1788390514.021643:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390514.021941:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390514.021957:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390514.022003:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390514.022049:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390514.022073:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 5 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390514.022092:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103266816:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390514.022242:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390514.026619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.026772:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846272 00000100:00100000:0.0:1788390514.026787:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846272 00000100:00100000:3.0:1788390514.026833:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103266816:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390514.026870:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.026872:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 6 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.026921:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390514.026934:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093846272:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390514.026954:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390514.026982:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 6 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.026997:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 6 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.027026:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd330e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef46 expref: 6 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.027046:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:0.0:1788390514.027053:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.027064:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.027092:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.027123:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390514.027201:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2356:x1875263093846272:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 269us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.027210:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:2.0:1788390514.027389:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390514.028156:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.028171:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.028212:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.028225:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.028252:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390514.030916:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788390514.030941:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.030955:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.030997:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.031004:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390514.031010:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.031018:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.031041:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a35e8600) 00010000:00010000:3.0:1788390514.031044:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390514.031051:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.031057:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33183 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390514.031085:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214bc7c5 reply state 000000003cc6244e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.031109:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390514.031467:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+10:14427:x1875263093846144:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 9959us (10572us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788390514.031480:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:1.0:1788390514.035107:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035133:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035142:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035148:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.035154:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035162:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035215:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95d6a704cb00) 00010000:00010000:1.0:1788390514.035218:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.035224:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.035230:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd3318a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390514.062051:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788390514.088512:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.088890:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846400 00000100:00100000:1.0:1788390514.088902:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846400 00000100:00100000:1.0:1788390514.089064:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390514.089078:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+9:14435:x1875263093846400:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:1.0:1788390514.089112:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390514.089142:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef70 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089221:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd33198 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089236:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd33198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089246:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd33198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390514.089288:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390514.089291:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390514.089334:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd33198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089380:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef70 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089395:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd33198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef70 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.089403:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:1.0:1788390514.089405:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390514.089409:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62a00, rc 0) 00000100:00100000:1.0:1788390514.089485:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+10:14435:x1875263093846400:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 411us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.089493:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390514.103266:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.103372:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846528 00000100:00100000:3.0:1788390514.103386:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846528 00000100:00100000:3.0:1788390514.103456:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390514.103470:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:14436:x1875263093846528:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390514.103499:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.103525:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3319f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef77 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104067:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd331a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104086:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd331a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104098:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd331a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390514.104142:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390514.104145:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390514.104165:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd331a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104190:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3319f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef77 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104232:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd331a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef77 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.104239:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:3.0:1788390514.104242:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390514.104245:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390514.104313:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:14436:x1875263093846528:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 846us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.104321:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390514.106935:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.108194:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846656 00000100:00100000:1.0:1788390514.108214:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846656 00000100:00100000:1.0:1788390514.108298:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390514.108312:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:14436:x1875263093846656:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390514.108341:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390514.108372:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd331ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef7e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108460:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108479:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108491:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108656:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108666:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.108686:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109089:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109110:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109122:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390514.109170:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390514.109174:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390514.109204:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109215:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109220:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109224:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109242:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.109245:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109250:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109259:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:1.0:1788390514.109260:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.109263:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109267:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109279:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109282:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109286:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109289:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.109290:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109293:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109303:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95d683b5a900) 00010000:00010000:1.0:1788390514.109305:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.109306:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109310:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109346:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd331ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef7e expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109355:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef7e expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.109360:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:1.0:1788390514.109361:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390514.109362:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390514.109508:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+7:14436:x1875263093846656:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1197us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.109514:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390514.113331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.113436:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093846912 00000100:00100000:3.0:1788390514.113449:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093846912 00000100:00100000:3.0:1788390514.113551:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390514.113561:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+7:14436:x1875263093846912:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390514.113600:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.113620:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd331c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef85 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390514.113719:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788390514.113839:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd331c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef85 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.113854:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:3.0:1788390514.113857:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390514.113863:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd331c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef85 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.113906:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390514.113999:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+8:14436:x1875263093846912:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 438us (675us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788390514.114006:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390514.122100:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.122211:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093847168 00000100:00100000:1.0:1788390514.122222:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093847168 00000100:00100000:1.0:1788390514.122276:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390514.122286:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+8:14436:x1875263093847168:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:1.0:1788390514.122339:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390514.122366:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd331c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef7e expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.122404:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:1.0:1788390514.122420:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390514.122443:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.122456:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.122465:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390514.123008:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc44afce reply state 000000000c2047b5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.123019:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788390514.123113:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788390514.123236:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+9:14436:x1875263093847168:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 949us (1145us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788390514.123244:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390514.125320:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103267200:0@lo:400:kworker.0 00000100:00100000:1.0:1788390514.125387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390514.125444:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103267712:0@lo:400:kworker.0 00000100:00100000:1.0:1788390514.125471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390514.125494:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390514.125500:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103267328:0@lo:400:kworker.0 00000100:00100000:1.0:1788390514.125534:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390514.125598:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103266944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390514.125630:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390514.125656:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103267456:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.125692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390514.125711:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390514.125717:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103267072:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.125748:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390514.125752:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267200 00000100:00100000:2.0:1788390514.125761:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267200 00000100:00100000:3.0:1788390514.125776:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103267584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.125804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390514.125816:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267328 00000100:00100000:2.0:1788390514.125820:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267328 00000100:00100000:3.0:1788390514.125840:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390514.125849:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390514.125853:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390514.125860:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103267328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390514.125914:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103267328:12345-0@lo:400:kworker.0 Request processed in 57us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.125919:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103267200:12345-0@lo:400:kworker.0 Request processed in 67us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390514.125925:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390514.125933:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390514.125951:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267072 00000100:00100000:2.0:1788390514.125955:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267072 00000100:00100000:2.0:1788390514.125996:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788390514.126003:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103267072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.126082:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267712 00000100:00100000:3.0:1788390514.126088:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267712 00000100:00100000:3.0:1788390514.126113:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267456 00000100:00100000:3.0:1788390514.126116:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267456 00000100:00100000:3.0:1788390514.126133:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103267584 00000100:00100000:3.0:1788390514.126135:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103267584 00000100:00100000:3.0:1788390514.126152:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788390514.126167:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390514.126174:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390514.126179:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103267712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390514.126179:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390514.126195:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788390514.126205:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788390514.126222:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103267712:12345-0@lo:400:kworker.0 Request processed in 46us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.126230:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390514.126246:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390514.126253:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103267456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390514.126531:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103267072:12345-0@lo:400:kworker.0 Request processed in 528us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390514.126538:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788390514.126786:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390514.126795:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103267584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390514.126954:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103266944 00000100:00100000:1.0:1788390514.126998:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103266944 00000100:00100000:1.0:1788390514.127142:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390514.127150:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103266944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390514.127178:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390514.127787:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103267584:12345-0@lo:400:kworker.0 Request processed in 991us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.127796:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390514.127823:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103267456:12345-0@lo:400:kworker.0 Request processed in 1567us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.127832:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390514.128002:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788390514.128025:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.128037:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103267328:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.128052:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093847424 00000100:00100000:0.0:1788390514.128058:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103267200:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.128059:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093847424 00000100:00100000:0.0:1788390514.128079:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103267712:0@lo:400:kworker.0 00000100:00100000:3.0:1788390514.128102:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390514.128112:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+9:14436:x1875263093847424:12345-192.168.202.1@tcp:35:lfs.0 00010000:00010000:0.0:1788390514.128152:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128174:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128182:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128188:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.128193:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128201:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128217:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d683b5ab00) 00010000:00010000:0.0:1788390514.128220:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788390514.128226:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.128233:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd331d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.128333:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+9:14436:x1875263093847424:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 223us (311us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788390514.128342:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788390514.129335:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103267072:0@lo:400:kworker.0 00000100:00100000:2.0:1788390514.129358:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103267584:0@lo:400:kworker.0 00000100:00100000:1.0:1788390514.129418:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103266944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2269us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.129427:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390514.129552:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103266944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390514.129566:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103267456:0@lo:400:kworker.0 00000100:00100000:0.0:1788390514.130746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.130885:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093847680 00000100:00100000:1.0:1788390514.130893:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093847680 00000100:00100000:1.0:1788390514.130951:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390514.130991:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+9:14436:x1875263093847680:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390514.131013:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390514.131042:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd331de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef8c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131115:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131130:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131141:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131154:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131161:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131182:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390514.131290:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788390514.131371:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131378:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131385:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131392:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.131396:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131404:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131415:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:1.0:1788390514.131419:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.131423:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131430:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd331e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131443:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131458:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131464:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131469:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.131472:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131478:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131485:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95d683b5a900) 00010000:00010000:1.0:1788390514.131488:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.131490:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131496:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd331ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131551:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd331de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef8c expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131562:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:1.0:1788390514.131564:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390514.131568:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd331de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef8c expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.131786:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390514.131859:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+10:14436:x1875263093847680:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 898us (1116us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788390514.131867:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390514.137914:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.138034:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093847808 00000100:00100000:3.0:1788390514.138044:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093847808 00000100:00100000:3.0:1788390514.138105:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390514.138117:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+10:14436:x1875263093847808:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390514.138142:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.138166:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd331fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef93 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138267:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138297:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138310:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390514.138339:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390514.138342:0:16577:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390514.138362:0:16577:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138389:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd331fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 12 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138407:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 11 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.138417:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390514.138420:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390514.138424:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390514.138480:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+11:14436:x1875263093847808:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 365us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.138487:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390514.143776:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.143934:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093847936 00000100:00100000:0.0:1788390514.143946:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093847936 00000100:00100000:0.0:1788390514.144312:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390514.144324:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+11:14436:x1875263093847936:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:1.0:1788390514.149840:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+11:14436:x1875263093847936:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 5506us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.149856:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390514.152564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.152831:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093848192 00000100:00100000:0.0:1788390514.152844:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093848192 00000100:00100000:0.0:1788390514.152917:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1788390514.152931:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+11:14436:x1875263093848192:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390514.153456:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+12:14436:x1875263093848192:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 527us (899us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788390514.153465:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390514.204439:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.204539:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093848320 00000100:00100000:0.0:1788390514.204549:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093848320 00000100:00100000:0.0:1788390514.204681:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390514.204692:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+10:14442:x1875263093848320:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390514.204723:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390514.204744:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfef9a expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204805:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204820:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204831:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204846:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204853:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.204860:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205001:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c800/0x9aafc5f04cd3321d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205010:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c800/0x9aafc5f04cd3321d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205027:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c800/0x9aafc5f04cd3321d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390514.205055:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390514.205058:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390514.205097:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c800/0x9aafc5f04cd3321d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205107:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205111:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205118:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205123:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.205127:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205134:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205145:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:0.0:1788390514.205154:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.205159:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205165:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3320f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205175:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205179:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205183:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205185:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.205187:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205190:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205195:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95d684d23b00) 00010000:00010000:0.0:1788390514.205196:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.205198:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205201:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33216 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205220:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef9a expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205237:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c800/0x9aafc5f04cd3321d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef9a expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.205243:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390514.205244:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788390514.205246:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c800, rc 0) 00000100:00100000:0.0:1788390514.205294:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+11:14442:x1875263093848320:12345-192.168.202.1@tcp:101:bash.0 Request processed in 605us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.205299:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1788390514.207618:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.207703:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093848576 00000100:00100000:3.0:1788390514.207711:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093848576 00000100:00100000:3.0:1788390514.207776:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788390514.207785:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+11:14442:x1875263093848576:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390514.207804:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.207821:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd33224 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefa1 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.207925:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.207939:0:16577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 11 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.207948:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.208008:0:16577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 11 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.208032:0:16577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 11 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.208044:0:16577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103267840:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390514.208175:0:16577:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390514.211254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.211557:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093848704 00000100:00100000:3.0:1788390514.211566:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093848704 00010000:00010000:3.0:1788390514.211612:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 12 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.211653:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390514.211690:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+12:2357:x1875263093848704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390514.211704:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390514.211711:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 12 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.211725:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 12 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.211747:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390514.211752:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.211761:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.211770:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.211787:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390514.211841:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+12:2357:x1875263093848704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 153us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.211849:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00010000:00010000:0.0:1788390514.213027:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33201 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfef93 expref: 11 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.213116:0:16577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103267840:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390514.213138:0:16577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.213149:0:16577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.213155:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.213178:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.213190:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.213211:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214191:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214203:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214213:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390514.214224:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390514.214250:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214257:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214264:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214270:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.214274:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214281:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214292:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390514.214294:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.214306:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214313:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3322b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390514.214326:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c13ce5 reply state 000000005d8470f1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.214335:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390514.214368:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd33224 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 14 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214383:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 13 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.214390:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390514.214392:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788390514.214395:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31dc00, rc 0) 00000100:00100000:0.0:1788390514.214457:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:14442:x1875263093848576:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6673us (6846us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788390514.214466:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00010000:00010000:1.0:1788390514.217081:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217098:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217106:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217112:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.217116:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217124:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217150:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23b00) 00010000:00010000:1.0:1788390514.217153:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.217157:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.217177:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33232 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.225271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.225813:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093848832 00000100:00100000:0.0:1788390514.225825:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093848832 00000100:00100000:0.0:1788390514.225887:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788390514.225899:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+13:14442:x1875263093848832:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390514.225930:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390514.225952:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd33247 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefa8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228222:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228242:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228255:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390514.228294:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788390514.228298:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390514.228319:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228328:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228351:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd33247 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 15 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228367:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.228373:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390514.228375:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390514.228377:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390514.228487:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:14442:x1875263093848832:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2590us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390514.228493:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390514.232076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.232717:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093849088 00000100:00100000:1.0:1788390514.232728:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093849088 00000100:00100000:1.0:1788390514.232787:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390514.232798:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+14:14442:x1875263093849088:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1788390514.233203:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+15:14442:x1875263093849088:12345-192.168.202.1@tcp:35:bash.0 Request processed in 406us (1133us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788390514.233212:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390514.289110:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.289181:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093849344 00000100:00100000:0.0:1788390514.289192:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093849344 00000100:00100000:0.0:1788390514.289257:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390514.289268:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+15:14452:x1875263093849344:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390514.289294:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390514.289320:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefaf expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390514.289413:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390514.289535:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33255 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefaf expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.289549:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:0.0:1788390514.289552:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390514.289557:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefaf expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.289570:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c200, rc 0) 00000100:00100000:0.0:1788390514.289631:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+16:14452:x1875263093849344:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 365us (533us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788390514.289639:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788390514.292061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.292108:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093849600 00000100:00100000:0.0:1788390514.292118:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093849600 00000100:00100000:0.0:1788390514.292288:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390514.292300:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+16:14452:x1875263093849600:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390514.292546:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+17:14452:x1875263093849600:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 247us (492us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788390514.292554:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788390514.329757:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.330097:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093849856 00000100:00100000:3.0:1788390514.330108:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093849856 00000100:00100000:3.0:1788390514.330210:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390514.330221:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+17:14456:x1875263093849856:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390514.330244:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.330274:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd33263 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefb6 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.330399:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3326a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.330412:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3326a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.330423:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3326a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390514.330442:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390514.330559:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd33263 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefb6 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.330579:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3326a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefb6 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.330587:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390514.330590:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788390514.330593:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1800, rc 0) 00000100:00100000:3.0:1788390514.330651:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+19:14456:x1875263093849856:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 431us (912us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788390514.330658:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390514.333432:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.333702:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093849984 00000100:00100000:0.0:1788390514.333711:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093849984 00000100:00100000:0.0:1788390514.333883:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788390514.333914:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+19:14456:x1875263093849984:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1788390514.334035:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334056:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334069:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334097:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334103:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334109:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334114:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.334118:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334125:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334152:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390514.334155:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390514.334161:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.334168:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33278 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.334251:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+19:14456:x1875263093849984:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 349us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.334259:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788390514.622688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.622857:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093850240 00000100:00100000:1.0:1788390514.622867:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093850240 00000100:00100000:1.0:1788390514.622985:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788390514.622997:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+19:14493:x1875263093850240:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788390514.623018:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390514.623038:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd3327f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefbd expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623148:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623164:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 20 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623173:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 20 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623199:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623233:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 20 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623247:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 20 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.623260:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103267968:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390514.623358:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 20 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.623367:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 20 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.623376:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103268096:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390514.623398:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390514.627906:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390514.627944:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390514.628048:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093850368 00000100:00100000:0.0:1788390514.628057:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093850368 00010000:00010000:0.0:1788390514.628106:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 21 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.628139:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093850496 00000100:00100000:0.0:1788390514.628143:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093850496 00010000:00010000:0.0:1788390514.628156:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 22 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390514.628170:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390514.628178:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+22:2356:x1875263093850368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390514.628191:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390514.628197:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 22 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628209:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 22 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628244:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390514.628249:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628257:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628264:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390514.628318:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+22:2356:x1875263093850368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 139us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.628326:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390514.628345:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390514.628352:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+21:2356:x1875263093850496:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390514.628360:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390514.628365:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 21 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628374:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 21 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628385:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390514.628389:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628397:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628414:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.628431:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390514.628451:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+21:2356:x1875263093850496:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 99us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.628457:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:1.0:1788390514.629230:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3324e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa8 expref: 20 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.629249:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103267968:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390514.629260:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33239 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefa1 expref: 19 pid: 16577 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.629285:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103268096:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390514.629304:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.629312:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.629318:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390514.629337:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788390514.629517:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd3327f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 20 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.629532:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 19 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.629539:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390514.629542:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390514.629545:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390514.629708:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+19:14493:x1875263093850240:12345-192.168.202.1@tcp:101:dd.0 Request processed in 6713us (7029us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788390514.629715:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788390514.633779:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390514.633838:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093850752 00000100:00100000:1.0:1788390514.633915:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093850752 00000100:00100000:1.0:1788390514.634009:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788390514.634021:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+19:14493:x1875263093850752:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:1.0:1788390514.634386:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.634406:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.634418:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390514.634472:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:1.0:1788390514.634499:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f942a341 reply state 000000001a3286d1 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.634507:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390514.634698:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14493:x1875263093850752:12345-192.168.202.1@tcp:36:dd.0 Request processed in 679us (929us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788390514.634707:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000020:00080000:1.0:1788390514.634712:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390514.639185:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639203:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639212:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639218:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.639223:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639231:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639260:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390514.639263:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.639268:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.639275:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33294 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.765134:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390514.888933:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.889159:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093850880 00000100:00100000:3.0:1788390514.889169:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093850880 00000100:00100000:3.0:1788390514.889234:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788390514.889261:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+21:14507:x1875263093850880:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:3.0:1788390514.889289:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390514.889309:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3329b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefc4 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889374:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889387:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889398:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889411:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889418:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889425:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889508:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889519:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889528:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889571:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.889584:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 22 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.889597:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103268224:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390514.889749:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390514.894130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.894170:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103268224:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390514.894197:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390514.894221:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093851136 00000100:00100000:1.0:1788390514.894231:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093851136 00000100:00100000:1.0:1788390514.894287:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390514.894296:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+23:13764:x1875263093851136:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390514.894537:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+24:13764:x1875263093851136:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 241us (415us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788390514.894544:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390514.897505:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.897575:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093851264 00000100:00100000:3.0:1788390514.897585:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093851264 00010000:00010000:3.0:1788390514.897629:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 24 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.897741:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390514.897751:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+24:2356:x1875263093851264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390514.897767:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390514.897775:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 24 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897789:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 24 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897831:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd33286 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefbd expref: 24 pid: 14354 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897846:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390514.897851:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897862:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897870:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.897903:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390514.898012:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+23:2356:x1875263093851264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 262us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390514.898020:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:0.0:1788390514.898224:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898234:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390514.898280:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788390514.898285:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390514.898320:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898332:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898342:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898349:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898356:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898372:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.898376:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898384:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898394:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390514.898397:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.898401:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898406:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd332a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898422:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898429:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898436:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898442:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390514.898445:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898452:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898470:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d6a704c900) 00010000:00010000:0.0:1788390514.898473:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390514.898476:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898483:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd332a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898519:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3329b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefc4 expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898534:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefc4 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390514.898542:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390514.898544:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390514.898546:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:0.0:1788390514.898589:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+22:14507:x1875263093850880:12345-192.168.202.1@tcp:101:stat.0 Request processed in 9330us (9665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390514.898596:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390514.961628:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390514.961770:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093851520 00000100:00100000:3.0:1788390514.961782:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093851520 00000100:00100000:3.0:1788390514.961844:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390514.961862:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+22:14513:x1875263093851520:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:3.0:1788390514.961926:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390514.961954:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefc4 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.962009:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390514.962015:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390514.962279:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.962294:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390514.962304:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390514.962352:0:16577:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788390514.962377:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d0daa2a reply state 00000000d6684055 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390514.962387:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390514.962499:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+24:14513:x1875263093851520:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 638us (879us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788390514.962508:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000020:00080000:3.0:1788390514.962524:0:16577:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390514.970408:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970427:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970439:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970445:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390514.970450:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970456:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970498:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390514.970501:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390514.970506:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390514.970512:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd332b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390515.089174:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.089685:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093851648 00000100:00100000:1.0:1788390515.089695:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093851648 00000100:00100000:1.0:1788390515.089812:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390515.089823:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+23:14527:x1875263093851648:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:1.0:1788390515.089847:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390515.089866:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd332be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefcb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.089931:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.089946:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.089985:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090015:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090023:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090046:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090127:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090135:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090152:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390515.090187:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788390515.090191:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390515.090211:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090231:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090377:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090385:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090392:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090397:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.090400:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090413:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090424:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390515.090427:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.090432:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090438:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd332c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090451:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090457:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090474:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090479:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.090482:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090489:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090496:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d683b5a900) 00010000:00010000:1.0:1788390515.090498:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.090501:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090517:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd332cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090551:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd332be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 25 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090576:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.090584:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390515.090586:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390515.090589:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390515.090667:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+24:14527:x1875263093851648:12345-192.168.202.1@tcp:101:stat.0 Request processed in 837us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390515.090675:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00080000:0.0:1788390515.092067:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390515.180667:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390515.180727:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093851904 00000100:00100000:3.0:1788390515.180739:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093851904 00000100:00100000:3.0:1788390515.180789:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788390515.180800:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+24:14537:x1875263093851904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390515.180820:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390515.180840:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefd2 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390515.180930:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788390515.181290:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd2 expref: 26 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.181306:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:3.0:1788390515.181316:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390515.181321:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd332da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd2 expref: 26 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.181339:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390515.181401:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+25:14537:x1875263093851904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 602us (752us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788390515.181409:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788390515.191001:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390515.191082:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093852160 00000100:00100000:3.0:1788390515.191091:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093852160 00000100:00100000:3.0:1788390515.191135:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788390515.191153:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+25:14537:x1875263093852160:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390515.191354:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+26:14537:x1875263093852160:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 202us (362us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788390515.191362:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000001:00080000:1.0:1788390515.200397:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:1.0:1788390515.200421:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788390515.200433:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1788390515.200467:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000100:00100000:0.0:1788390515.256720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.259490:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093852416 00000100:00100000:1.0:1788390515.259506:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093852416 00000100:00100000:0.0:1788390515.259956:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390515.260388:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+13:14543:x1875263093852416:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390515.260430:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390515.260452:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefd9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.260558:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.260574:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.260600:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.260649:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.260674:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 14 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390515.260689:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103268352:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390515.260853:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390515.266541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.266547:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103268352:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390515.266576:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390515.269150:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093852544 00000100:00100000:1.0:1788390515.269165:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093852544 00010000:00010000:1.0:1788390515.269267:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 15 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390515.269436:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390515.269452:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+15:2357:x1875263093852544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390515.269468:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390515.269476:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 15 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269490:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 15 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269514:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd332d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefcb expref: 15 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269532:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:2.0:1788390515.269538:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269548:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269572:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390515.269787:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390515.269863:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093852544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 415us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390515.269872:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:0.0:1788390515.271936:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.271953:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390515.272014:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788390515.272171:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 15 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.272192:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.272201:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390515.272205:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390515.272209:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c200, rc 0) 00000100:00100000:0.0:1788390515.272289:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:14543:x1875263093852416:12345-192.168.202.1@tcp:101:bash.0 Request processed in 11906us (15578us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788390515.272297:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788390515.277801:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.278821:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093852800 00000100:00100000:0.0:1788390515.278835:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093852800 00000100:00100000:0.0:1788390515.278900:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788390515.278913:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:14543:x1875263093852800:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1788390515.279234:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.279253:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.279265:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390515.279322:0:16577:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:0.0:1788390515.279362:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b440a947 reply state 0000000025cb5fd0 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390515.279371:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390515.279467:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+17:14543:x1875263093852800:12345-192.168.202.1@tcp:36:bash.0 Request processed in 556us (1678us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788390515.279475:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000020:00080000:0.0:1788390515.279481:0:16577:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390515.281820:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281852:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281860:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281866:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.281871:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281880:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281898:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390515.281901:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.281906:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.281912:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd332fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390515.286995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.287157:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093852928 00000100:00100000:0.0:1788390515.287167:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093852928 00000100:00100000:0.0:1788390515.287224:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390515.287234:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+16:14543:x1875263093852928:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390515.287257:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390515.287275:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd33304 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefe0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.287347:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.287361:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.287370:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.287402:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.287414:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 17 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390515.287445:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103268480:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390515.287532:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390515.290259:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103268480:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390515.290283:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390515.290503:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.290578:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093853056 00000100:00100000:0.0:1788390515.290585:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093853056 00010000:00010000:0.0:1788390515.290618:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 18 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390515.290701:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390515.290709:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+18:2357:x1875263093853056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390515.290720:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390515.290725:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 18 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290735:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 18 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290751:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd332ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefd9 expref: 18 pid: 14354 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290770:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390515.290773:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290796:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290802:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.290819:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390515.290860:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+17:2357:x1875263093853056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 152us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390515.290865:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:3.0:1788390515.291233:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.291242:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390515.291289:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788390515.291293:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390515.291314:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.291350:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd33304 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefe0 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.291365:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefe0 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.291372:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390515.291374:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390515.291377:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c400, rc 0) 00000100:00100000:3.0:1788390515.291462:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+16:14543:x1875263093852928:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4228us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390515.291470:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788390515.296211:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.296256:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093853312 00000100:00100000:1.0:1788390515.296265:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093853312 00000100:00100000:1.0:1788390515.296321:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390515.296332:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+16:14543:x1875263093853312:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1788390515.296577:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+17:14543:x1875263093853312:12345-192.168.202.1@tcp:35:bash.0 Request processed in 247us (386us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788390515.296584:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788390515.356939:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.357309:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093853568 00000100:00100000:1.0:1788390515.357332:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093853568 00000100:00100000:1.0:1788390515.357505:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788390515.357518:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+17:14553:x1875263093853568:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390515.357544:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390515.357565:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefe7 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390515.357667:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788390515.357799:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33312 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefe7 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.357814:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:1.0:1788390515.357817:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390515.357822:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefe7 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.357836:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390515.357896:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+18:14553:x1875263093853568:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 380us (967us total) trans 8589934617 rc 301/301 00000100:00100000:1.0:1788390515.357903:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788390515.363255:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.363445:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093853696 00000100:00100000:1.0:1788390515.363456:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093853696 00000100:00100000:1.0:1788390515.363515:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788390515.363527:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+18:14553:x1875263093853696:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788390515.363617:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.363636:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.363676:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.363692:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.363699:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.363705:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364079:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364089:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364096:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390515.364138:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364148:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364154:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364160:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364174:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.364179:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364185:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364330:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390515.364334:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.364339:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364345:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33320 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364357:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364362:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364367:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364372:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.364374:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364380:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364396:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d683b5a500) 00010000:00010000:1.0:1788390515.364399:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.364413:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364419:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33327 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364439:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364445:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364450:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364455:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.364457:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364463:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364471:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:1.0:1788390515.364473:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.364476:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.364481:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3332e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390515.364571:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+18:14553:x1875263093853696:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1045us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390515.364580:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788390515.367272:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.367369:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093853952 00000100:00100000:0.0:1788390515.367378:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093853952 00000100:00100000:0.0:1788390515.367437:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390515.367448:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+18:14553:x1875263093853952:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390515.367713:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+19:14553:x1875263093853952:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 266us (449us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788390515.367720:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390515.400837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.401155:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093854208 00000100:00100000:0.0:1788390515.401166:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093854208 00000100:00100000:0.0:1788390515.401230:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788390515.401241:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+19:14556:x1875263093854208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390515.401268:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390515.401288:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33335 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfefee expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401364:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401392:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401404:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401421:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401429:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401436:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401778:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3334a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401789:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3334a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401797:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3334a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390515.401807:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390515.401897:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401905:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401912:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401924:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390515.401928:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401935:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.401947:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390515.401950:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390515.401955:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402003:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3333c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402016:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402022:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402029:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402034:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390515.402036:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402042:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402061:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23500) 00010000:00010000:0.0:1788390515.402064:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390515.402067:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402072:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33343 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402113:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33335 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefee expref: 22 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402127:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3334a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefee expref: 21 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.402135:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390515.402137:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390515.402140:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c600, rc 0) 00000100:00100000:0.0:1788390515.402206:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+21:14556:x1875263093854208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 967us (1376us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1788390515.402215:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1788390515.405092:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.405196:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093854464 00000100:00100000:0.0:1788390515.405206:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093854464 00000100:00100000:0.0:1788390515.405313:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390515.405326:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+21:14556:x1875263093854464:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390515.405368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390515.405487:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093854592 00000100:00100000:3.0:1788390515.405493:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093854592 00000100:00100000:3.0:1788390515.405545:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390515.405555:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+23:2357:x1875263093854592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390515.405572:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390515.405597:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3334a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefee expref: 23 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.405617:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00000100:00100000:0.0:1788390515.405623:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+22:14556:x1875263093854464:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 297us (536us total) trans 8589934620 rc 0/0 00010000:00010000:3.0:1788390515.405624:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390515.405634:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390515.405668:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+22:2357:x1875263093854592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390515.405750:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788390515.407442:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390515.407529:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093854720 00000100:00100000:3.0:1788390515.407538:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093854720 00000100:00100000:3.0:1788390515.407685:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788390515.407694:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+21:14556:x1875263093854720:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390515.407755:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407770:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407782:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407808:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407814:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407822:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407828:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390515.407833:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407840:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407851:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:3.0:1788390515.407867:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390515.407872:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390515.407878:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33358 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390515.407980:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+21:14556:x1875263093854720:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 267us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390515.407989:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788390515.525160:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.525218:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093854848 00000100:00100000:0.0:1788390515.525229:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093854848 00000100:00100000:0.0:1788390515.525293:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390515.525304:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+21:14575:x1875263093854848:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390515.525326:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390515.525348:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3335f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeff5 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525419:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525432:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525443:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390515.525478:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390515.525482:0:16577:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390515.525682:0:16577:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525712:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3335f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeff5 expref: 23 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525731:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeff5 expref: 22 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.525740:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390515.525743:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390515.525760:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31ca00, rc 0) 00000100:00100000:0.0:1788390515.525825:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+22:14575:x1875263093854848:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 522us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390515.525832:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1788390515.534065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.534181:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855232 00000100:00100000:1.0:1788390515.534192:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855232 00000100:00100000:1.0:1788390515.534309:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390515.534320:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14575:x1875263093855232:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390515.534695:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+23:14575:x1875263093855232:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 375us (638us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788390515.534702:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390515.542596:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390515.542682:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855360 00000100:00100000:0.0:1788390515.542692:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855360 00000100:00100000:0.0:1788390515.542800:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788390515.542813:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+23:14575:x1875263093855360:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1788390515.542832:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788390515.542860:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd3330b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefe0 expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.542883:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3326a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfefb6 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390515.542908:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23800) 00010000:00010000:0.0:1788390515.542919:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390515.543024:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+21:14575:x1875263093855360:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 213us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390515.543032:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788390515.545472:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.545535:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855488 00000100:00100000:1.0:1788390515.545545:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855488 00000100:00100000:1.0:1788390515.545651:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788390515.545675:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+21:14575:x1875263093855488:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1788390515.545790:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.545806:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.545817:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390515.546480:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390515.546562:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788390515.546634:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788390515.546765:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+21:14575:x1875263093855488:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1089us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390515.546782:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788390515.573944:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390515.575006:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855616 00000100:00100000:1.0:1788390515.575020:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855616 00000100:00100000:1.0:1788390515.575075:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788390515.575085:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+21:14577:x1875263093855616:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390515.575108:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390515.575128:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33374 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfeffc expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575194:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575208:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575220:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575235:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575242:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575249:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575465:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575478:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575483:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390515.575512:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788390515.575515:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390515.575528:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575537:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575542:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575546:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575550:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575554:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.575565:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575572:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575583:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390515.575592:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.575597:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575603:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3337b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575615:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575621:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575627:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575632:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390515.575635:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575640:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575648:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d683b5a900) 00010000:00010000:1.0:1788390515.575650:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390515.575662:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575668:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33382 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575701:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd33374 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 23 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575719:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 22 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390515.575724:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:1.0:1788390515.575726:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390515.575727:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390515.575783:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14577:x1875263093855616:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 700us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390515.575788:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00010000:00010000:0.0:1788390515.790089:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390516.120645:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390516.120667:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390516.120719:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788390516.120726:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390516.120853:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1875263103268608:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390516.121683:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390516.138774:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.143540:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1875263103268608:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390516.144041:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855744 00000100:00100000:1.0:1788390516.144049:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855744 00000100:00100000:1.0:1788390516.144092:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390516.144100:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093855744:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788390516.144176:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093855744:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 76us (5411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390516.144183:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390516.152623:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.156119:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093855872 00000100:00100000:3.0:1788390516.156131:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093855872 00000100:00100000:3.0:1788390516.156683:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390516.156696:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093855872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390516.156726:0:14356:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390516.156838:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093855872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 146us (4225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.156846:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390516.163486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.163527:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093856000 00000100:00100000:3.0:1788390516.163536:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093856000 00000100:00100000:3.0:1788390516.163591:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788390516.163603:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093856000:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788390516.163685:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163701:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163722:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163737:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163744:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163751:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163821:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163830:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163838:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390516.163876:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788390516.163881:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390516.163896:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163907:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163913:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163930:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163936:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390516.163940:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163948:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163981:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23900) 00010000:00010000:3.0:1788390516.163985:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390516.163989:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.163995:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33390 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164012:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164020:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164026:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164031:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390516.164035:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164051:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164060:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff95d6a704cd00) 00010000:00010000:3.0:1788390516.164063:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390516.164065:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164071:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33397 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164092:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164098:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164104:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164111:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390516.164115:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164122:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164129:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:3.0:1788390516.164131:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390516.164134:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.164150:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd3339e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.164641:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093856000:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1036us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.164660:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788390516.167567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390516.167690:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093856256 00000100:00100000:1.0:1788390516.167699:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093856256 00000100:00100000:1.0:1788390516.167749:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1788390516.167760:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+22:14588:x1875263093856256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390516.167780:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390516.167799:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff003 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.167905:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.167926:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.167938:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390516.167950:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788390516.168454:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168463:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168470:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168475:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390516.168479:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168486:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168498:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:1.0:1788390516.168501:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390516.168505:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168512:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd333ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168546:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff003 expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168561:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23900) 00010000:00010000:1.0:1788390516.168564:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390516.168568:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff003 expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.168576:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390516.168630:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093856256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 872us (1071us total) trans 8589934622 rc 301/301 00000100:00100000:1.0:1788390516.168638:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788390516.172392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.172494:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093856384 00000100:00100000:0.0:1788390516.172505:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093856384 00000100:00100000:0.0:1788390516.172564:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1788390516.172575:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093856384:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390516.172616:0:16577:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390516.172729:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093856384:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 155us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.172737:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1788390516.177600:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.177694:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093856640 00000100:00100000:0.0:1788390516.177704:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093856640 00000100:00100000:0.0:1788390516.177763:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1788390516.177773:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093856640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390516.177794:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390516.177797:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390516.177823:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33366 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeff5 expref: 23 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.177838:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390516.177843:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390516.177855:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd333ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff00a expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390516.178688:0:14356:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788390516.178696:0:14356:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788390516.178742:0:14356:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788390516.179052:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd333c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.179066:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd333c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.179082:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd333c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.179147:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd333ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff00a expref: 25 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.179164:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd333c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff00a expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.179171:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390516.179173:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390516.179176:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d400, rc 0) 00000100:00100000:0.0:1788390516.179297:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+24:14588:x1875263093856640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1524us (1703us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788390516.179307:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788390516.186593:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.186726:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093856896 00000100:00100000:2.0:1788390516.186737:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093856896 00000100:00100000:2.0:1788390516.186799:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788390516.186809:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+24:14588:x1875263093856896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788390516.186866:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390516.186894:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd333c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff00a expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.186911:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d684d23500) 00010000:00010000:2.0:1788390516.186920:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390516.186943:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.186986:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.186997:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187011:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187017:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187024:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187217:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187234:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187241:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187246:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.187250:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187258:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187267:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:2.0:1788390516.187270:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390516.187273:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187278:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd333cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187287:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187293:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187298:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187303:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.187311:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187318:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187326:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5ff53b39 (ffff95d6a35e8500) 00010000:00010000:2.0:1788390516.187328:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390516.187331:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.187337:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd333d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ff53b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.187427:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093856896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 618us (843us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390516.187435:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788390516.191983:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.192562:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093857024 00000100:00100000:2.0:1788390516.192573:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093857024 00000100:00100000:2.0:1788390516.192845:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390516.192859:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+23:14588:x1875263093857024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390516.192880:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390516.192901:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd333dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff011 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.192937:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.192951:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.193005:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.193101:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd333dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 25 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.193117:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.193125:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:2.0:1788390516.193128:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390516.193131:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd800, rc 0) 00000100:00100000:2.0:1788390516.193195:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+24:14588:x1875263093857024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 340us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.193202:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390516.202216:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.206869:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093857280 00000100:00100000:3.0:1788390516.206882:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093857280 00000100:00100000:3.0:1788390516.206937:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788390516.206947:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+24:14588:x1875263093857280:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390516.207148:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.207164:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.207176:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390516.207449:0:16577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788390516.207458:0:16577:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333314496880ns, next at 334314494560ns, rc = 0 00000004:00010000:3.0:1788390516.207532:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff0bf5b0 reply state 000000001093554c transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.207541:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390516.207628:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+26:14588:x1875263093857280:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 681us (5420us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1788390516.207635:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000040:00080000:1.0:1788390516.208238:0:16615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390516.208244:0:16615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390516.208274:0:16615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788390516.208278:0:16615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390516.210682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390516.210720:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093857408 00000100:00100000:1.0:1788390516.210729:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093857408 00000100:00100000:1.0:1788390516.210777:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788390516.210788:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+26:14588:x1875263093857408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390516.210810:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390516.210829:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff018 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.210887:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 27 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.210916:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 27 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.210937:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:1.0:1788390516.210940:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390516.210944:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390516.211014:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+27:14588:x1875263093857408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 228us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390516.211021:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1788390516.214474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788390516.216775:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216791:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216798:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216803:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390516.216808:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216815:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216833:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:1.0:1788390516.216836:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390516.216840:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.216855:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd333eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.217320:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093857536 00000100:00100000:3.0:1788390516.217332:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093857536 00000100:00100000:3.0:1788390516.217421:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390516.217432:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093857536:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788390516.217869:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093857536:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 438us (3403us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788390516.217877:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1788390516.218134:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390516.224152:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.224224:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093857792 00000100:00100000:0.0:1788390516.224233:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093857792 00000100:00100000:0.0:1788390516.224287:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390516.224298:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+26:14588:x1875263093857792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390516.224523:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+27:14588:x1875263093857792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 226us (376us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1788390516.224531:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390516.230409:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.231373:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858048 00000100:00100000:2.0:1788390516.231384:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858048 00000100:00100000:2.0:1788390516.231644:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788390516.231664:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+27:14588:x1875263093858048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788390516.231774:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+27:14588:x1875263093858048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 113us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.231782:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788390516.236222:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390516.236641:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858176 00000100:00100000:1.0:1788390516.236659:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858176 00000100:00100000:1.0:1788390516.236714:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1788390516.236724:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+27:14588:x1875263093858176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390516.236745:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390516.236766:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd333f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff01f expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236829:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236843:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236854:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390516.236886:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390516.236901:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236925:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd333f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff01f expref: 29 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236951:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff01f expref: 28 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390516.236978:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:1.0:1788390516.236981:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390516.236985:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62200, rc 0) 00000100:00100000:1.0:1788390516.237031:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+28:14588:x1875263093858176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 310us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390516.237038:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788390516.240920:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.241024:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858304 00000100:00100000:3.0:1788390516.241034:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858304 00000100:00100000:3.0:1788390516.241094:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390516.241105:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093858304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390516.241123:0:16479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390516.241143:0:16479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff026 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390516.241169:0:16479:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac74, blocks: 0x1 00010000:00010000:3.0:1788390516.241186:0:16479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1788390516.241191:0:16479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390516.241202:0:16479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 7 pid: 16479 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.241222:0:16479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 7 pid: 16479 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.241237:0:16479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390516.241297:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+7:2356:x1875263093858304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 194us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.241304:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390516.243845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.243921:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858560 00000100:00100000:3.0:1788390516.243931:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858560 00000100:00100000:3.0:1788390516.244008:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1788390516.244018:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+28:14588:x1875263093858560:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390516.244112:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+28:14588:x1875263093858560:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.244120:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1788390516.247570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.247677:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858688 00000100:00100000:3.0:1788390516.247686:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858688 00000100:00100000:3.0:1788390516.247734:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390516.247743:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+7:14588:x1875263093858688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390516.247759:0:15040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390516.247776:0:15040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff02d expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.247804:0:15040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 8 pid: 16479 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.247814:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390516.247818:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390516.247823:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.247865:0:15040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 8 pid: 16479 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.247879:0:15040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 8 pid: 16479 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.247892:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15040:1875263103268736:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390516.247994:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390516.254913:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.254945:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858816 00000100:00100000:0.0:1788390516.254952:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858816 00010000:00010000:0.0:1788390516.255009:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 9 pid: 16479 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.255058:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390516.255067:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+9:2357:x1875263093858816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390516.255082:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390516.255104:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 9 pid: 16479 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.255119:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 9 pid: 16479 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.255143:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390516.255148:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390516.255162:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 9 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.255173:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 9 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.255212:0:14339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 9 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.255227:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14339:1875263103268864:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390516.255301:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788390516.255575:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd543ef/0x9aafc5f04cd33407 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff026 expref: 9 pid: 16479 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.255590:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15040:1875263103268736:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390516.255611:0:15040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.255621:0:15040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390516.255877:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+8:14588:x1875263093858688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 8134us (8314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.255886:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390516.256944:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14339:1875263103268864:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788390516.257069:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390516.257209:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093858816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2140us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.257219:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390516.265178:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.265251:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093858944 00000100:00100000:2.0:1788390516.265261:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093858944 00002000:00100000:2.0:1788390516.265306:0:15046:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff95d6bbcf0a80 x1875263093858944/t0(0) o4->c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp:132/0 lens 504/0 e 0 to 0 dl 1788390527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788390516.265317:0:15046:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263093858944 ext(0->8) 00002000:00010000:2.0:1788390516.265323:0:15046:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:2.0:1788390516.265362:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788390516.265374:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093858944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788390516.265954:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c81d4476-fbab-45da-be95-db71a881e268+9:2357:x1875263093858944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 582us (783us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788390516.265985:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:2.0:1788390516.265993:0:15046:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff95d6bbcf0a80 x1875263093858944/t8589934595(0) o4->c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp:132/0 lens 504/448 e 0 to 0 dl 1788390527 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788390516.266002:0:15046:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263093858944 ext(0->8) 00002000:00010000:2.0:1788390516.266006:0:15046:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:3.0:1788390516.269803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390516.269874:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859072 00000100:00100000:1.0:1788390516.269883:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859072 00000100:00100000:1.0:1788390516.269942:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788390516.269953:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+28:14588:x1875263093859072:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788390516.284854:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:1.0:1788390516.284928:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788390516.285030:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+13:14588:x1875263093859072:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 15073us (15229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.285046:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788390516.285074:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103268992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788390516.285222:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390516.285256:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103268992 00000100:00100000:0.0:1788390516.285263:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103268992 00000100:00080000:2.0:1788390516.285301:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390516.285317:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390516.285326:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103268992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788390516.285455:0:16479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788390516.285459:0:16479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788390516 00002000:00010000:0.0:1788390516.285461:0:16479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390516.285464:0:16479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788390516 -> 1788390516 00002000:00010000:0.0:1788390516.285466:0:16479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788390516.285508:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103268992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (285us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788390516.285514:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788390516.285556:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d682e95180/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788390516.285564:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103268992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788390516.287918:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.288041:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859200 00000100:00100000:3.0:1788390516.288056:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859200 00000100:00100000:3.0:1788390516.288104:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390516.288115:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+9:2356:x1875263093859200:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390516.317466:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1788390516.317487:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000100:00100000:3.0:1788390516.317697:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093859200:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 29578us (29788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.317710:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390516.323643:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.323789:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859456 00000100:00100000:3.0:1788390516.323799:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859456 00000100:00100000:3.0:1788390516.323855:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788390516.323867:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+13:14588:x1875263093859456:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390516.323923:0:16577:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390516.323948:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33400 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff01f expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.324043:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:3.0:1788390516.324049:0:16577:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390516.324082:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.324096:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.324107:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390516.324283:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e808593 reply state 000000005cee3090 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.324292:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390516.324429:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:14588:x1875263093859456:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 565us (798us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788390516.324437:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00010000:00010000:0.0:1788390516.327106:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327122:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327131:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327137:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390516.327142:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327167:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327184:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:0.0:1788390516.327409:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390516.327415:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.327423:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd33415 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.327610:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.327666:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859584 00000100:00100000:0.0:1788390516.327676:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859584 00000100:00100000:0.0:1788390516.327730:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390516.327742:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093859584:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788390516.328047:0:16479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788390516.328051:0:16479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788390516 -> 1788390515 00002000:00010000:0.0:1788390516.328053:0:16479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788390514 00002000:00010000:0.0:1788390516.328055:0:16479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788390516 -> 1788390515 00002000:00010000:0.0:1788390516.328057:0:16479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788390516.328111:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093859584:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 371us (503us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788390516.328118:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788390516.335953:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.336080:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859840 00000100:00100000:2.0:1788390516.336090:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859840 00000100:00100000:2.0:1788390516.336147:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788390516.336170:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+13:14588:x1875263093859840:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788390516.336250:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.336267:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.336276:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.336311:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.336325:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 13 pid: 14356 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.336339:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103269120:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390516.336428:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390516.338927:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103269120:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390516.339082:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390516.339921:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.341834:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093859968 00000100:00100000:0.0:1788390516.341847:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093859968 00010000:00010000:0.0:1788390516.341892:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 14 pid: 14356 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.341954:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390516.341984:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093859968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390516.342016:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390516.342024:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 14 pid: 14356 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342037:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 14 pid: 14356 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342059:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd333e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff011 expref: 14 pid: 14356 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342074:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:0.0:1788390516.342079:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342088:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342095:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.342121:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390516.342142:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342151:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342180:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.342193:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+13:2357:x1875263093859968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (2273us total) trans 0 rc 0/0 00010000:00010000:2.0:1788390516.342196:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.342206:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:2.0:1788390516.342208:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342217:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.342221:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342229:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342239:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:2.0:1788390516.342241:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788390516.342245:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.342251:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3341c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.342293:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+12:14588:x1875263093859840:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 6125us (6349us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788390516.342301:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1788390516.351488:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.351592:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860096 00000100:00100000:2.0:1788390516.351602:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860096 00000100:00100000:2.0:1788390516.351671:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390516.351683:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093860096:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788390516.351736:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.351781:0:15040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 7 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.351790:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390516.351795:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390516.351800:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.351835:0:15040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 7 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.351850:0:15040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 7 pid: 15040 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.351865:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15040:1875263103269248:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390516.351948:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390516.354911:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15040:1875263103269248:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390516.354943:0:15040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390516.358151:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.358309:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860224 00000100:00100000:2.0:1788390516.358319:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860224 00010000:00010000:2.0:1788390516.358364:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.358429:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390516.358441:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+8:2357:x1875263093860224:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390516.358458:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390516.358484:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.358499:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.358525:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd3340e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff02d expref: 8 pid: 15040 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.358546:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390516.358550:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390516.358555:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.358565:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.358596:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390516.358625:0:15040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358645:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.358670:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093860224:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 230us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.358679:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:0.0:1788390516.358686:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358697:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358706:0:15040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358714:0:15040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390516.358719:0:15040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358727:0:15040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358739:0:15040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.358747:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ec2aaf/0x9aafc5f04cd33423 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.358804:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093860096:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 7124us (7326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.358811:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390516.365126:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.365238:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860480 00000100:00100000:2.0:1788390516.365248:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860480 00000100:00100000:2.0:1788390516.365308:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788390516.365318:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+12:14588:x1875263093860480:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788390516.365397:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365415:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365428:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365673:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365685:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365694:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365727:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.365742:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 13 pid: 14354 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.365881:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103269376:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390516.366046:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390516.369428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.369701:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860608 00000100:00100000:0.0:1788390516.369711:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860608 00010000:00010000:0.0:1788390516.369760:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 14 pid: 14354 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.369796:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390516.369804:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093860608:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390516.369816:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390516.369821:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 14 pid: 14354 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.369830:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 14 pid: 14354 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.369848:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:0.0:1788390516.369852:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.369859:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.369868:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.369899:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390516.369944:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093860608:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 141us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.369949:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:2.0:1788390516.372095:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd333f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff018 expref: 13 pid: 14354 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.372117:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103269376:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390516.372193:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.372203:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.372210:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390516.372403:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1788390516.372530:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1788390516.372569:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1788390516.372645:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103269504:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788390516.372753:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390516.372790:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875dfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390516.372840:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103269504 00000100:00100000:3.0:1788390516.372845:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103269504 00000100:00100000:3.0:1788390516.372883:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390516.372889:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14355:x1875263103269504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788390516.372948:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14355:x1875263103269504:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.372953:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390516.373404:0:14355:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:2.0:1788390516.373410:0:14355:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d682e95180, transno 8589934596 00000100:00100000:2.0:1788390516.373428:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103269504:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788390516.374173:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:2.0:1788390516.374269:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103269632:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788390516.374325:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390516.374355:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390516.374383:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103269632 00000100:00100000:2.0:1788390516.374389:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103269632 00000100:00100000:2.0:1788390516.374436:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390516.374455:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14355:x1875263103269632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788390516.374692:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1875263103269632:12345-0@lo:1000:mdt00_001.0 Request processed in 238us (366us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788390516.374700:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390516.374753:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103269632:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788390516.374792:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374802:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374810:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374817:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.374822:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374830:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374848:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d6a35e8d00) 00010000:00010000:2.0:1788390516.374851:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390516.374855:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374861:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd33431 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374899:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374912:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374917:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374922:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.374926:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374932:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374942:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:2.0:1788390516.374945:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390516.374948:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.374953:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd3336d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.375006:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.375020:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.375030:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.375057:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.375078:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 16 pid: 14355 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.375090:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103269760:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390516.375167:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390516.379607:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103269760:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390516.379642:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390516.382109:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.382193:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860736 00000100:00100000:2.0:1788390516.382203:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860736 00010000:00010000:2.0:1788390516.382247:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 17 pid: 14355 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390516.382295:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390516.382305:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+17:2356:x1875263093860736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390516.382320:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390516.382327:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 17 pid: 14355 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382340:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 17 pid: 14355 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382361:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33389 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfeffc expref: 17 pid: 14355 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382377:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:2.0:1788390516.382381:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382407:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382414:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382439:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390516.382486:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+16:2356:x1875263093860736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 183us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.382493:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:2.0:1788390516.382613:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382621:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382633:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382638:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382644:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382663:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.382668:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382675:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382691:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:2.0:1788390516.382694:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390516.382698:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382703:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd33438 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382714:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382719:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382724:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382729:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390516.382731:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382736:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382742:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d683b5a500) 00010000:00010000:2.0:1788390516.382744:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390516.382747:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390516.382752:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3342a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390516.383119:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390516.383124:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390516.383152:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788390516.383157:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390516.383235:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+15:14588:x1875263093860480:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 17917us (18118us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1788390516.383244:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00080000:2.0:1788390516.383248:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788390516.387469:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.390771:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093860992 00000100:00100000:0.0:1788390516.390785:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093860992 00000100:00100000:0.0:1788390516.390917:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788390516.390926:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+15:14588:x1875263093860992:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788390516.391644:0:14357:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788390516.391789:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:0.0:1788390516.391829:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391842:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391851:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391856:0:14357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391860:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391872:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390516.391990:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390516.391993:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390516.392000:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390516.392089:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+17:14588:x1875263093860992:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1161us (4627us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788390516.392097:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000020:00080000:0.0:1788390516.392103:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390516.393859:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390516.393866:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.393876:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.393894:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:3.0:1788390516.393897:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390516.393902:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.393925:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3343f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390516.393949:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390516.393951:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390516.393953:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390516.685278:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390516.685304:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103269888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390516.685391:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390516.685540:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103269888 00000100:00100000:2.0:1788390516.685549:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103269888 00000100:00100000:2.0:1788390516.685615:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390516.685626:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103269888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390516.685672:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788390516.685675:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390516.685731:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103269888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.685738:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390516.685791:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103269888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390516.813129:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390516.855746:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.855862:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.856116:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861504 00000100:00100000:2.0:1788390516.856128:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861504 00000100:00100000:0.0:1788390516.856184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.856302:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.856335:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390516.856359:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861760 00000100:00100000:2.0:1788390516.856365:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861760 00000100:00100000:2.0:1788390516.856407:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390516.856431:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093861504:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390516.856501:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093861504:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.856510:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390516.856548:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788390516.856560:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093861760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390516.856585:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861248 00000100:00100000:2.0:1788390516.856591:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093861760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390516.856591:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861248 00000100:00100000:2.0:1788390516.856601:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390516.856636:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390516.856657:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+17:2358:x1875263093861248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390516.856692:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+17:2358:x1875263093861248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.859017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390516.859209:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390516.859355:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861376 00000100:00100000:3.0:1788390516.859363:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861376 00000100:00100000:3.0:1788390516.859402:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861888 00000100:00100000:3.0:1788390516.859406:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861888 00000100:00100000:2.0:1788390516.859812:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861632 00000100:00100000:2.0:1788390516.859817:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861632 00000100:00100000:1.0:1788390516.859847:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390516.859931:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390516.859943:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2358:x1875263093861376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390516.860010:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093861120 00000100:00100000:0.0:1788390516.860016:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093861120 00000100:00100000:3.0:1788390516.860025:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2358:x1875263093861376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.860034:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390516.860052:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390516.860061:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093861888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390516.860083:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093861888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390516.860088:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:3.0:1788390516.860103:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390516.860107:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390516.860109:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390516.860361:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788390516.860373:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093861120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390516.860402:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093861120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390516.860409:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1788390516.862145:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390516.862163:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093861632:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390516.862253:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093861632:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 97us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390516.862261:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:2.0:1788390517.841014:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390517.905443:0:16672:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390517.905451:0:16672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390517.906184:0:16672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788390517.906191:0:16672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390518.037934:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390518.038044:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093862144 00000100:00100000:2.0:1788390518.038055:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093862144 00000100:00080000:3.0:1788390518.038103:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390518.038127:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390518.038140:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+17:14606:x1875263093862144:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390518.038161:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390518.038180:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff034 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390518.038272:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788390518.038383:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33446 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff034 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.038396:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d683b5a400) 00010000:00010000:2.0:1788390518.038399:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390518.038402:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff034 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.038411:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc800, rc 0) 00000100:00100000:2.0:1788390518.038461:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+18:14606:x1875263093862144:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 324us (538us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788390518.038468:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788390518.043759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.043811:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093862272 00000100:00100000:3.0:1788390518.043823:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093862272 00000100:00100000:3.0:1788390518.043895:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788390518.043906:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+18:14606:x1875263093862272:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788390518.044005:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044024:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044040:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044056:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044063:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044070:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044436:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044445:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044451:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390518.044487:0:16577:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044499:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044511:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044518:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044523:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.044528:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044536:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044547:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390518.044550:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390518.044566:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044573:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd33454 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044588:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044594:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044600:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044605:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.044614:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044620:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044627:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390518.044630:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390518.044645:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044651:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3345b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044666:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044672:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044678:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044683:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.044686:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044691:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044698:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d6a704cf00) 00010000:00010000:3.0:1788390518.044701:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390518.044707:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.044713:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd33462 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.044792:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+18:14606:x1875263093862272:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 887us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.044801:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788390518.050797:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.050879:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093862528 00000100:00100000:3.0:1788390518.050889:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093862528 00000100:00100000:3.0:1788390518.050938:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390518.050949:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+18:14606:x1875263093862528:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390518.051201:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+19:14606:x1875263093862528:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 253us (414us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788390518.051210:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390518.088360:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.088422:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093862784 00000100:00100000:0.0:1788390518.088435:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093862784 00000100:00100000:0.0:1788390518.088488:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1788390518.088511:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+19:14609:x1875263093862784:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390518.088536:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390518.088556:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33469 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff03b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088628:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088659:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088671:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088686:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088692:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.088698:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.089104:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.089279:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.089287:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390518.089305:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1788390518.089487:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089495:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089502:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089509:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.089513:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089520:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089534:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390518.089537:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390518.089549:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089555:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33470 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089569:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089576:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089581:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089587:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.089589:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089594:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089601:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23b00) 00010000:00010000:1.0:1788390518.089604:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390518.089606:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089611:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33477 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089719:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33469 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089747:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 21 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.089755:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:1.0:1788390518.089758:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390518.089760:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d400, rc 0) 00000100:00100000:1.0:1788390518.089836:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+21:14609:x1875263093862784:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1326us (1484us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788390518.089844:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1788390518.092416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.092490:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093862912 00000100:00100000:0.0:1788390518.092500:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093862912 00000100:00100000:0.0:1788390518.092644:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1788390518.092662:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+21:14609:x1875263093862912:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1788390518.092722:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092736:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092748:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092772:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092779:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092786:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092792:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.092796:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092803:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092831:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390518.092833:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390518.092838:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.092844:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd3348c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.092911:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+21:14609:x1875263093862912:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 250us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.092919:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1788390518.094535:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.094579:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093863168 00000100:00100000:3.0:1788390518.094588:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093863168 00000100:00100000:3.0:1788390518.094650:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390518.094661:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+21:14609:x1875263093863168:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390518.094921:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+22:14609:x1875263093863168:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 262us (392us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788390518.094926:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788390518.127084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390518.127197:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093863424 00000100:00100000:2.0:1788390518.127207:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093863424 00000100:00100000:2.0:1788390518.127301:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788390518.127312:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+22:12137:x1875263093863424:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390518.127339:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390518.127360:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33493 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff042 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.127467:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.127483:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.127512:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.127550:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.127565:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 23 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.127579:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103270016:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390518.127686:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390518.130298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.130382:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093863552 00000100:00100000:0.0:1788390518.130391:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093863552 00010000:00010000:0.0:1788390518.130428:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 24 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.130472:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390518.130482:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+24:2357:x1875263093863552:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390518.130496:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390518.130502:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 24 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.130516:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 24 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.130542:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390518.130548:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.130570:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.130578:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.130595:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390518.130657:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+24:2357:x1875263093863552:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.130666:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:2.0:1788390518.131604:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd3347e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff03b expref: 23 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.131624:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103270016:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390518.131654:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.131663:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.131670:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390518.131689:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1788390518.131883:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33493 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.131914:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.131922:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:2.0:1788390518.131925:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390518.131928:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:2.0:1788390518.132180:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+23:12137:x1875263093863424:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4869us (5105us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788390518.132188:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788390518.134201:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.134279:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093863808 00000100:00100000:3.0:1788390518.134290:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093863808 00000100:00100000:3.0:1788390518.134379:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390518.134389:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+23:12137:x1875263093863808:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1788390518.134685:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.134700:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.134725:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390518.134777:0:16577:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:3.0:1788390518.134802:0:16577:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a86af6a9 reply state 000000008dd2dd43 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.134811:0:16577:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788390518.134893:0:16577:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:3.0:1788390518.135104:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+27:12137:x1875263093863808:12345-192.168.202.1@tcp:36:bash.0 Request processed in 715us (910us total) trans 8589934641 rc 0/0 00000100:00100000:3.0:1788390518.135112:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000020:00080000:3.0:1788390518.135117:0:16577:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788390518.140341:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140364:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140373:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140379:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.140385:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140392:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140429:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:1.0:1788390518.140433:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390518.140439:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.140446:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390518.141017:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.141247:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093863936 00000100:00100000:3.0:1788390518.141257:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093863936 00000100:00100000:3.0:1788390518.141326:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788390518.141337:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+26:12137:x1875263093863936:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390518.141361:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.141378:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd334af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff049 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.141441:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd334af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff049 expref: 27 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.141471:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd334af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff049 expref: 27 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.141489:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:3.0:1788390518.141493:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390518.141496:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00100000:3.0:1788390518.141694:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+27:12137:x1875263093863936:12345-192.168.202.1@tcp:101:bash.0 Request processed in 358us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.141702:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1788390518.152212:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.154041:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864064 00000100:00100000:3.0:1788390518.154055:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864064 00000100:00100000:3.0:1788390518.154190:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390518.154203:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:12137:x1875263093864064:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390518.154222:0:15042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.154244:0:15042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff050 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390518.154274:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a98ac73, atime: 0x6a98ac72, ctime: 0x6a98ac73, blocks: 0xb 00010000:00010000:3.0:1788390518.154295:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788390518.154299:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390518.154307:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.154325:0:15042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.154359:0:15042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0200, rc 0) 00000100:00100000:3.0:1788390518.154431:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+7:12137:x1875263093864064:12345-192.168.202.1@tcp:101:bash.0 Request processed in 232us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.154439:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:0.0:1788390518.155621:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390518.157423:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.157646:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864192 00000100:00100000:0.0:1788390518.157655:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864192 00002000:00010000:0.0:1788390518.157692:0:15048:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:0.0:1788390518.157697:0:15048:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687862a00 with x1875263093864192 ext(0->18446744073709551615) 00002000:00010000:0.0:1788390518.157710:0:15048:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687862a00. 00000100:00100000:0.0:1788390518.157781:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788390518.157792:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093864192:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:0.0:1788390518.158087:0:15048:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788390518.158091:0:15048:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788390515 -> 1788390518 00002000:00010000:0.0:1788390518.158094:0:15048:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1788390514 -> 1788390514 00002000:00010000:0.0:1788390518.158096:0:15048:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788390515 -> 1788390518 00002000:00010000:0.0:1788390518.158098:0:15048:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788390518.158152:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2357:x1875263093864192:12345-192.168.202.1@tcp:10:bash.0 Request processed in 361us (738us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788390518.158160:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00010000:0.0:1788390518.158178:0:15048:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:0.0:1788390518.158181:0:15048:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687862a00 with x1875263093864192 ext(0->18446744073709551615) 00002000:00010000:0.0:1788390518.158186:0:15048:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687862a00. 00000100:00100000:2.0:1788390518.236261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.237172:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864448 00000100:00100000:0.0:1788390518.237183:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864448 00000100:00100000:0.0:1788390518.237290:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1788390518.237300:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+27:14623:x1875263093864448:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390518.237322:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390518.237342:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff057 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.237443:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd334c4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.237457:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd334c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.237469:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd334c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390518.237480:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390518.237610:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff057 expref: 30 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.237640:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d400/0x9aafc5f04cd334c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff057 expref: 29 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.237650:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390518.237652:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390518.237669:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d400, rc 0) 00000100:00100000:0.0:1788390518.237742:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+29:14623:x1875263093864448:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 443us (1488us total) trans 8589934642 rc 0/0 00000100:00100000:0.0:1788390518.237750:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788390518.249201:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.249371:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864576 00000100:00100000:0.0:1788390518.249381:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864576 00000100:00100000:0.0:1788390518.249476:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1788390518.249488:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+29:14623:x1875263093864576:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788390518.249564:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.249581:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.249592:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.249607:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.249615:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.249621:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251198:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251213:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251238:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390518.251284:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251296:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251303:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251309:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251314:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.251318:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251325:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251337:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390518.251340:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.251344:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251351:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd334d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251363:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251376:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251381:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251385:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.251388:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251394:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251403:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23c00) 00010000:00010000:0.0:1788390518.251405:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.251408:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251413:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd334d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251428:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251434:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251439:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251444:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.251454:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251459:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251466:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390518.251468:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.251470:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.251476:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd334e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.251622:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+29:14623:x1875263093864576:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 2131us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.251641:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788390518.289398:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.289613:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864832 00000100:00100000:3.0:1788390518.289623:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864832 00000100:00100000:3.0:1788390518.289848:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788390518.289857:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+29:14626:x1875263093864832:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390518.289875:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.289891:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd334e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff05e expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.289950:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.289978:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.289988:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.289997:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290002:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290006:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290240:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290249:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290257:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390518.290266:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390518.290353:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290358:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290363:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290366:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.290369:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290373:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290381:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390518.290383:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390518.290386:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290396:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd334ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290409:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290412:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290416:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290419:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.290420:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290423:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290427:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d6a704ca00) 00010000:00010000:3.0:1788390518.290429:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390518.290430:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290433:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd334f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290465:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd334e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff05e expref: 32 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290503:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff05e expref: 31 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.290508:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:3.0:1788390518.290510:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788390518.290511:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390518.290569:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+31:14626:x1875263093864832:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 714us (1181us total) trans 8589934643 rc 0/0 00000100:00100000:3.0:1788390518.290574:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788390518.294095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.294173:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093864960 00000100:00100000:3.0:1788390518.294183:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093864960 00000100:00100000:3.0:1788390518.294241:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788390518.294252:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+31:14626:x1875263093864960:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390518.294320:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.294337:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 31 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.294347:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.294384:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 31 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.294397:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 31 pid: 14356 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.294430:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103270144:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390518.294556:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390518.298291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.298375:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093865216 00000100:00100000:0.0:1788390518.298385:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093865216 00000100:00100000:0.0:1788390518.298447:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390518.298458:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+32:13765:x1875263093865216:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788390518.298808:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+33:13765:x1875263093865216:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 351us (526us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1788390518.298816:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390518.301488:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103270144:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390518.301514:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.301722:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390518.301785:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093865344 00000100:00100000:1.0:1788390518.301790:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093865344 00010000:00010000:1.0:1788390518.301822:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 33 pid: 14356 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390518.301842:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788390518.301849:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+33:2357:x1875263093865344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390518.301860:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390518.301865:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 33 pid: 14356 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301874:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 33 pid: 14356 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301891:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3349a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff042 expref: 33 pid: 14356 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301919:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:1.0:1788390518.301922:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301929:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301934:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.301956:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390518.302033:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+32:2357:x1875263093865344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 183us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390518.302041:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:3.0:1788390518.302706:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302716:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302751:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302770:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302778:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302784:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.302788:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302795:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302808:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:3.0:1788390518.302820:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390518.302824:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.302831:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3350a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.302885:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+31:14626:x1875263093864960:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 8634us (8798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.302893:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788390518.306571:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.306666:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093865600 00000100:00100000:0.0:1788390518.306677:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093865600 00000100:00100000:0.0:1788390518.306737:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390518.306747:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+31:14626:x1875263093865600:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788390518.306993:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+32:14626:x1875263093865600:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 247us (432us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1788390518.307012:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390518.405078:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.405168:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093865856 00000100:00100000:0.0:1788390518.405179:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093865856 00000100:00100000:0.0:1788390518.405242:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1788390518.405254:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+32:14637:x1875263093865856:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1788390518.405279:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390518.405300:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33511 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff065 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405373:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405387:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405398:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405412:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405420:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405427:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405705:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33526 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405725:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33526 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405733:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33526 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390518.405743:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1788390518.405952:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405986:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405993:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.405999:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.406003:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406011:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406023:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390518.406026:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.406031:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406037:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33518 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406049:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406060:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406066:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406071:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.406074:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406079:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406086:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23c00) 00010000:00010000:0.0:1788390518.406088:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.406090:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406095:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3351f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406168:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33511 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff065 expref: 35 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406183:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33526 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff065 expref: 34 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.406190:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390518.406192:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390518.406199:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d800, rc 0) 00000100:00100000:0.0:1788390518.406268:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+34:14637:x1875263093865856:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1016us (1199us total) trans 8589934646 rc 0/0 00000100:00100000:0.0:1788390518.406277:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788390518.412832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.414860:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093866112 00000100:00100000:0.0:1788390518.414875:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093866112 00000100:00100000:0.0:1788390518.415013:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390518.415025:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+34:14637:x1875263093866112:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:0.0:1788390518.415272:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+35:14637:x1875263093866112:12345-192.168.202.1@tcp:35:cat.0 Request processed in 249us (2448us total) trans 8589934647 rc 0/0 00000100:00100000:0.0:1788390518.415281:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390518.439088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.439174:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093866368 00000100:00100000:0.0:1788390518.439184:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093866368 00000100:00100000:0.0:1788390518.439247:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788390518.439257:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+35:14638:x1875263093866368:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:0.0:1788390518.439315:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788390518.439341:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33526 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff065 expref: 35 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439360:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd334fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff05e expref: 34 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439378:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd334af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff049 expref: 33 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439387:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23500) 00010000:00010000:0.0:1788390518.439396:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390518.439431:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439444:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439452:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439465:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439472:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439478:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.439756:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.440021:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.440029:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390518.442211:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:1.0:1788390518.442226:0:14356:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335549265116ns, next at 336549262226ns, rc = 0 00010000:00010000:1.0:1788390518.442306:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442324:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442334:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442342:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442348:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442366:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442423:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390518.442466:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442473:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442479:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442496:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.442501:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442508:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442521:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390518.442524:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788390518.442528:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442534:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd33542 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442553:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442559:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442570:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442574:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.442577:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442583:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442590:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390518.442592:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390518.442595:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.442600:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33534 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390518.442611:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000536971e5 reply state 00000000191fc369 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390518.442620:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390518.442742:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+34:14638:x1875263093866368:12345-192.168.202.1@tcp:36:rm.0 Request processed in 3482us (3659us total) trans 8589934648 rc 0/0 00000100:00100000:1.0:1788390518.442751:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00010000:00010000:0.0:1788390518.443750:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390518.443882:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.443892:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390518.443897:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.443917:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.443933:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.443937:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788390518.443941:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.443946:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd33549 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.443992:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390518.443994:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390518.443996:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390518.446497:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446514:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446521:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446527:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.446531:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446546:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446562:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23c00) 00010000:00010000:0.0:1788390518.446575:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.446580:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.446586:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd3353b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.511899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.512071:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093866624 00000100:00100000:0.0:1788390518.512082:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093866624 00000100:00100000:0.0:1788390518.512151:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788390518.512163:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+33:14644:x1875263093866624:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788390518.512190:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390518.512215:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33550 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff06c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512341:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512358:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512369:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512383:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512390:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.512397:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513118:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513130:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513138:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390518.513148:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788390518.513175:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513182:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513189:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513195:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.513199:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513206:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513230:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:0.0:1788390518.513233:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.513238:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513253:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd33557 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390518.513267:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fa95346 reply state 00000000b61eb794 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.513275:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390518.513305:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33550 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 36 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513319:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 35 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.513327:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.513329:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788390518.513332:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31dc00, rc 0) 00000100:00100000:0.0:1788390518.513431:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+36:14644:x1875263093866624:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1270us (1542us total) trans 8589934649 rc 0/0 00000100:00100000:0.0:1788390518.513441:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:0.0:1788390518.516407:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516422:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516429:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516435:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390518.516452:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516459:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516475:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23c00) 00010000:00010000:0.0:1788390518.516478:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390518.516494:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.516502:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd3355e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.519574:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.519727:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093866752 00000100:00100000:3.0:1788390518.519737:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093866752 00000100:00100000:3.0:1788390518.519802:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390518.519813:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+35:14644:x1875263093866752:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390518.519837:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.519857:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33573 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff073 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.519924:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.519939:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.519951:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390518.520017:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788390518.520022:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390518.520041:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.520069:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.520092:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33573 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 37 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.520111:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 36 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.520119:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390518.520121:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390518.520124:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173a200, rc 0) 00000100:00100000:3.0:1788390518.520188:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+36:14644:x1875263093866752:12345-192.168.202.1@tcp:101:bash.0 Request processed in 376us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.520195:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390518.526922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390518.527066:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093867008 00000100:00100000:1.0:1788390518.527077:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093867008 00000100:00100000:1.0:1788390518.527136:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390518.527147:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+36:14644:x1875263093867008:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1788390518.527504:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+37:14644:x1875263093867008:12345-192.168.202.1@tcp:35:bash.0 Request processed in 357us (591us total) trans 8589934650 rc 0/0 00000100:00100000:1.0:1788390518.527512:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390518.652883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390518.653063:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093867264 00000100:00100000:1.0:1788390518.653072:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093867264 00000100:00100000:0.0:1788390518.653203:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788390518.653214:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+37:14657:x1875263093867264:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390518.653237:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390518.653259:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33581 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff07a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.653372:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33588 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.653386:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.653399:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390518.653411:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788390518.653536:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd33581 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff07a expref: 40 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.653551:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff07a expref: 39 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.653560:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.653563:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390518.653565:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c600, rc 0) 00000100:00100000:0.0:1788390518.653814:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+39:14657:x1875263093867264:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 603us (939us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1788390518.653820:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1788390518.656570:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390518.656657:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.656732:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093867520 00000100:00100000:0.0:1788390518.656742:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093867520 00000100:00100000:0.0:1788390518.656808:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390518.656818:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+39:2358:x1875263093867520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390518.656832:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390518.656856:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd33588 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff07a expref: 39 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.656873:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.656878:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390518.656935:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+38:2358:x1875263093867520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.656943:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390518.657527:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093867392 00000100:00100000:3.0:1788390518.657533:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093867392 00000100:00100000:3.0:1788390518.657571:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390518.657579:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+38:14657:x1875263093867392:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390518.657639:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657653:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657661:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657703:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657710:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657716:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657722:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390518.657726:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657733:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657742:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390518.657745:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390518.657748:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.657753:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd33596 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.657804:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+38:14657:x1875263093867392:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 226us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.657811:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390518.659406:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390518.659488:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093867776 00000100:00100000:1.0:1788390518.659495:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093867776 00000100:00100000:1.0:1788390518.659541:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390518.659550:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+38:14657:x1875263093867776:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390518.659769:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+39:14657:x1875263093867776:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 218us (368us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1788390518.659776:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390518.715456:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.715518:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868032 00000100:00100000:3.0:1788390518.715527:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868032 00000100:00100000:3.0:1788390518.715578:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788390518.715604:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+39:14667:x1875263093868032:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390518.715648:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.715669:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3359d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff081 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715765:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715776:0:16577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 40 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715782:0:16577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715787:0:16577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715811:0:16577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715820:0:16577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.715829:0:16577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103270272:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390518.715910:0:16577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 40 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.715916:0:16577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 40 pid: 14355 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.715928:0:16577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103270400:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390518.715944:0:16577:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390518.718827:0:16577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd03100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103270272:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390518.718843:0:16577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16577:1875263103270400:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390518.718868:0:16577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.720549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.720742:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390518.720916:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868288 00000100:00100000:1.0:1788390518.720929:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868288 00010000:00010000:1.0:1788390518.721021:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 41 pid: 14355 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390518.721103:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868160 00000100:00100000:1.0:1788390518.721107:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868160 00010000:00010000:1.0:1788390518.721121:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 42 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.721160:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390518.721174:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+42:2357:x1875263093868288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390518.721193:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390518.721200:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 42 pid: 14355 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721211:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 42 pid: 14355 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721233:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd33565 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff06c expref: 42 pid: 14355 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721252:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.721258:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721268:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721276:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390518.721336:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+41:2357:x1875263093868288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 166us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.721342:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390518.721358:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390518.721364:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+40:2357:x1875263093868160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390518.721373:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390518.721387:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721403:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721416:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a200/0x9aafc5f04cd3357a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff073 expref: 40 pid: 14354 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721430:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.721435:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721445:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721452:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.721480:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390518.721495:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+39:2357:x1875263093868160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 132us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.721502:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00010000:00010000:2.0:1788390518.721603:0:16577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.721714:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390518.721756:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788390518.721915:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd3359d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 40 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.721937:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 39 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.721946:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:2.0:1788390518.721949:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390518.721952:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173b400, rc 0) 00000100:00100000:2.0:1788390518.722164:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+39:14667:x1875263093868032:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6557us (6710us total) trans 8589934653 rc 0/0 00000100:00100000:2.0:1788390518.722175:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1788390518.731058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.731187:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868544 00000100:00100000:3.0:1788390518.731198:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868544 00000100:00100000:3.0:1788390518.731390:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788390518.731401:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+39:14667:x1875263093868544:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1788390518.731676:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.731693:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.731706:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390518.731757:0:14354:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:3.0:1788390518.731780:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007307b84f reply state 000000000f3ee0dd transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.731789:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390518.731882:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+42:14667:x1875263093868544:12345-192.168.202.1@tcp:36:bash.0 Request processed in 482us (833us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1788390518.731904:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000020:00080000:3.0:1788390518.731909:0:14354:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390518.737794:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737813:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737820:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737842:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390518.737847:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737855:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737873:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390518.737875:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390518.737880:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390518.737886:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd335b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390518.739871:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390518.740031:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868672 00000100:00100000:2.0:1788390518.740041:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868672 00000100:00100000:2.0:1788390518.740099:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390518.740110:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+41:14667:x1875263093868672:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390518.740192:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390518.740301:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd335b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff088 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.740363:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd335b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff088 expref: 42 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.740381:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd335b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff088 expref: 42 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.740422:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:2.0:1788390518.740425:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390518.740429:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd000, rc 0) 00000100:00100000:2.0:1788390518.740519:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+42:14667:x1875263093868672:12345-192.168.202.1@tcp:101:bash.0 Request processed in 410us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390518.740527:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1788390518.745128:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390518.745346:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868800 00000100:00100000:2.0:1788390518.745357:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868800 00000100:00100000:2.0:1788390518.745418:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788390518.745430:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+42:14667:x1875263093868800:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390518.745454:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390518.745636:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff08f expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.745723:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.745739:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 43 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.745748:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.745783:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 43 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.745797:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 43 pid: 16577 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.745825:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103270528:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390518.746850:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390518.749672:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.749863:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093868928 00000100:00100000:3.0:1788390518.749872:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093868928 00010000:00010000:3.0:1788390518.749909:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 44 pid: 16577 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390518.749949:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390518.749987:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+44:2357:x1875263093868928:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390518.750002:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390518.750010:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 44 pid: 16577 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.750023:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 44 pid: 16577 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.750044:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390518.750048:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.750057:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.750065:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.750082:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390518.750129:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c81d4476-fbab-45da-be95-db71a881e268+44:2357:x1875263093868928:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 171us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.750149:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00010000:00010000:2.0:1788390518.750392:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd335a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff081 expref: 43 pid: 16577 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390518.750413:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875263103270528:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390518.750435:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.750444:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.750449:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390518.751781:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390518.751789:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390518.751812:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.751848:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff08f expref: 43 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.751866:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff08f expref: 42 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390518.751873:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:2.0:1788390518.751887:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390518.751890:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:2.0:1788390518.751944:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+42:14667:x1875263093868800:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6515us (6827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390518.751952:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1788390518.756290:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390518.756392:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869184 00000100:00100000:0.0:1788390518.756402:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869184 00000100:00100000:0.0:1788390518.756503:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390518.756513:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+42:14667:x1875263093869184:12345-192.168.202.1@tcp:103:bash.0 00010000:00010000:0.0:1788390518.756554:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788390518.756579:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd335c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff08f expref: 42 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.756600:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd335b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff088 expref: 41 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390518.756611:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390518.756620:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390518.756689:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+40:14667:x1875263093869184:12345-192.168.202.1@tcp:103:bash.0 Request processed in 176us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390518.756697:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390518.759744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.759841:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869312 00000100:00100000:3.0:1788390518.759849:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869312 00000100:00100000:3.0:1788390518.759938:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390518.759948:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+40:14667:x1875263093869312:12345-192.168.202.1@tcp:58:bash.0 00010000:00010000:3.0:1788390518.760078:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.760094:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.760104:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390518.760438:0:16577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:3.0:1788390518.760513:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+40:14667:x1875263093869312:12345-192.168.202.1@tcp:58:bash.0 Request processed in 566us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.760522:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390518.762069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390518.762096:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869440 00000100:00100000:3.0:1788390518.762103:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869440 00000100:00100000:3.0:1788390518.762150:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788390518.762159:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+40:14667:x1875263093869440:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788390518.762175:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390518.762193:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff096 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762289:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762316:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 41 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762333:0:14354:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762346:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 41 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762359:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:3.0:1788390518.762362:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390518.762365:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 41 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390518.762372:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173a400, rc 0) 00000100:00100000:3.0:1788390518.762419:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+41:14667:x1875263093869440:12345-192.168.202.1@tcp:101:bash.0 Request processed in 260us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390518.762425:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00010000:00010000:2.0:1788390518.861527:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390519.247310:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103270784:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.247382:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390519.247447:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103271296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.247472:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390519.247494:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390519.247499:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103270912:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.247517:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.247587:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103271040:0@lo:400:kworker.0 00000100:00100000:0.0:1788390519.247613:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.247648:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390519.247653:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103270656:0@lo:400:kworker.0 00000100:00100000:0.0:1788390519.247680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.247703:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103271168:0@lo:400:kworker.0 00000100:00100000:0.0:1788390519.247724:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.247747:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103270656 00000100:00100000:0.0:1788390519.247754:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103270656 00000100:00100000:0.0:1788390519.247796:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390519.247804:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390519.247849:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103270656:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.247875:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390519.247926:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103270656:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.248007:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271296 00000100:00100000:1.0:1788390519.248011:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271296 00000100:00100000:1.0:1788390519.248050:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271040 00000100:00100000:1.0:1788390519.248059:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271040 00000100:00100000:1.0:1788390519.248077:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271168 00000100:00100000:1.0:1788390519.248078:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271168 00000100:00100000:1.0:1788390519.248092:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390519.248098:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103271296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.248136:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103271296:12345-0@lo:400:kworker.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.248142:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390519.248167:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103271296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.248185:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390519.248191:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103271040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.248235:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103271040:12345-0@lo:400:kworker.0 Request processed in 44us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.248240:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390519.248251:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390519.248257:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103271168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.248283:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103271168:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.248289:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788390519.248433:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390519.248453:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103271168:0@lo:400:kworker.0 00000100:00100000:0.0:1788390519.248461:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788390519.248577:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103270784 00000100:00100000:2.0:1788390519.248582:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103270784 00000100:00100000:2.0:1788390519.248635:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103270912 00000100:00100000:2.0:1788390519.248638:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103270912 00000100:00100000:2.0:1788390519.248660:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390519.248667:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103270784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390519.248705:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103270784:12345-0@lo:400:kworker.0 Request processed in 39us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.248711:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390519.248723:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390519.248728:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103270912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390519.248755:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103270912:12345-0@lo:400:kworker.0 Request processed in 27us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.248760:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390519.250156:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103271424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390519.250207:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.250286:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271424 00000100:00100000:0.0:1788390519.250291:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271424 00000100:00100000:0.0:1788390519.250324:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390519.250330:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103271424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390519.250357:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390519.250398:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103271424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.250402:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390519.250462:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103271424:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788390519.250519:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390519.250525:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390519.250547:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103270912:0@lo:400:kworker.0 00000100:00100000:1.0:1788390519.250560:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fd03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103270784:0@lo:400:kworker.0 00000040:00080000:2.0:1788390519.439196:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390519.439206:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390519.439312:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390519.439320:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390519.439440:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1875263103271552:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390519.439903:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390519.442142:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1875263103271552:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390519.443859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.444040:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869568 00000100:00100000:1.0:1788390519.444052:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869568 00000100:00100000:1.0:1788390519.444132:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390519.444172:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+41:14668:x1875263093869568:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390519.444216:0:16577:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390519.444361:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+41:14668:x1875263093869568:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 202us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.444370:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390519.448664:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.449413:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869696 00000100:00100000:2.0:1788390519.449430:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869696 00000100:00100000:2.0:1788390519.449659:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1788390519.449673:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+41:14668:x1875263093869696:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.449782:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449804:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449820:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449837:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449845:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449852:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449880:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449889:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.449896:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390519.449992:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390519.449998:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390519.450015:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450028:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450034:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450042:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450048:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390519.450053:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450061:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450076:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23900) 00010000:00010000:2.0:1788390519.450093:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390519.450099:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450106:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd335dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450123:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450140:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450146:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450151:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390519.450155:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450170:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450179:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff95d6a35e8100) 00010000:00010000:2.0:1788390519.450182:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390519.450185:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450191:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd335e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450209:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450215:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450221:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450238:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390519.450247:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450254:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450261:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:2.0:1788390519.450263:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390519.450266:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.450272:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd335ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390519.450375:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+41:14668:x1875263093869696:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 701us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.450385:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788390519.452437:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.452657:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093869952 00000100:00100000:1.0:1788390519.452672:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093869952 00000100:00100000:1.0:1788390519.452791:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390519.452805:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+41:14668:x1875263093869952:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390519.452833:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390519.452859:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd335f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff09d expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453369:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453389:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453403:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390519.453418:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788390519.453545:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453553:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453580:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453587:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.453591:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453599:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453612:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:1.0:1788390519.453616:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390519.453633:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453641:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd335f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453697:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd335f1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff09d expref: 43 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453709:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23900) 00010000:00010000:1.0:1788390519.453712:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390519.453716:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd335f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff09d expref: 43 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.453726:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62200, rc 0) 00000100:00100000:1.0:1788390519.453804:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+42:14668:x1875263093869952:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1003us (1382us total) trans 8589934656 rc 301/301 00000100:00100000:1.0:1788390519.453821:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788390519.456848:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390519.456936:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093870080 00000100:00100000:3.0:1788390519.456950:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093870080 00000100:00100000:3.0:1788390519.457236:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788390519.457247:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+42:14668:x1875263093870080:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390519.457295:0:14354:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390519.457430:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+42:14668:x1875263093870080:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 185us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390519.457452:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788390519.463631:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.463809:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093870336 00000100:00100000:2.0:1788390519.463824:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093870336 00000100:00100000:2.0:1788390519.463898:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788390519.463910:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+42:14668:x1875263093870336:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.463939:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390519.463995:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd33606 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0a4 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390519.465439:0:14355:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788390519.465448:0:14355:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788390519.465610:0:14355:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788390519.465877:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd3360d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.465918:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd3360d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.465932:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd3360d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.466063:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd33606 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0a4 expref: 45 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.466256:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd3360d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0a4 expref: 44 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.466268:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d6a35e8100) 00010000:00010000:2.0:1788390519.466271:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390519.466276:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:2.0:1788390519.466425:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+44:14668:x1875263093870336:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2515us (2815us total) trans 8589934657 rc 0/0 00000100:00100000:2.0:1788390519.466436:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:1.0:1788390519.469829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.470566:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093870592 00000100:00100000:2.0:1788390519.470583:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093870592 00000100:00100000:2.0:1788390519.470712:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1788390519.470726:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+44:14668:x1875263093870592:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.470808:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390519.470838:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd3360d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0a4 expref: 44 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.470860:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d6a35e8100) 00010000:00010000:2.0:1788390519.470884:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390519.470911:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.470927:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.470939:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471497:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471519:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471529:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471597:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471602:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471607:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471611:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390519.471615:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471630:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471659:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:2.0:1788390519.471662:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390519.471666:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471672:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3361b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471686:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471693:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471702:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471708:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390519.471710:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471716:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471723:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xbc2a871e (ffff95d6a35e8500) 00010000:00010000:2.0:1788390519.471725:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390519.471728:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.471734:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33622 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2a871e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390519.471867:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+43:14668:x1875263093870592:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1140us (2051us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390519.471876:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788390519.478197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.478261:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093870720 00000100:00100000:1.0:1788390519.478279:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093870720 00000100:00100000:1.0:1788390519.478406:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788390519.478418:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+43:14668:x1875263093870720:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390519.478445:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390519.478479:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33629 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0ab expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478519:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33630 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478539:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33630 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478549:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33630 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478691:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33629 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0ab expref: 45 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478720:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd33630 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0ab expref: 44 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.478727:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:1.0:1788390519.478729:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390519.478733:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390519.478811:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+44:14668:x1875263093870720:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 395us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.478817:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1788390519.481305:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390519.481399:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093870976 00000100:00100000:3.0:1788390519.481417:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093870976 00000100:00100000:3.0:1788390519.481534:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788390519.481545:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+44:14668:x1875263093870976:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390519.481640:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390519.481657:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390519.481668:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390519.482224:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788390519.482236:0:14354:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336589274269ns, next at 337589271539ns, rc = 0 00000004:00010000:3.0:1788390519.482333:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2edebd5 reply state 0000000046ac8151 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390519.482344:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390519.482467:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+46:14668:x1875263093870976:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 922us (1176us total) trans 8589934658 rc 0/0 00000100:00100000:3.0:1788390519.482476:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788390519.484479:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.484542:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093871104 00000100:00100000:2.0:1788390519.484558:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093871104 00000100:00100000:2.0:1788390519.484643:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788390519.484657:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+46:14668:x1875263093871104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.484688:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390519.484710:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0b2 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.484777:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 47 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.484789:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 47 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.484806:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:2.0:1788390519.484808:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390519.484812:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:2.0:1788390519.484883:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+47:14668:x1875263093871104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 230us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.484888:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788390519.487702:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.488035:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093871232 00000100:00100000:2.0:1788390519.488047:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093871232 00000100:00100000:1.0:1788390519.488261:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390519.488273:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+5:2357:x1875263093871232:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1788390519.488519:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488539:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488548:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488577:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390519.488582:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488590:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488612:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:0.0:1788390519.488616:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390519.488633:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.488640:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a600/0x9aafc5f04cd33637 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.488889:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093871232:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 617us (1201us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788390519.488896:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00080000:2.0:1788390519.488934:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390519.491479:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.491542:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093871488 00000100:00100000:1.0:1788390519.491553:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093871488 00000100:00100000:1.0:1788390519.491645:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788390519.491659:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+46:14668:x1875263093871488:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390519.492425:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+47:14668:x1875263093871488:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 766us (962us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1788390519.492433:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390519.494423:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.494476:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093871744 00000100:00100000:2.0:1788390519.494490:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093871744 00000100:00100000:2.0:1788390519.494608:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788390519.494630:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+47:14668:x1875263093871744:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788390519.494794:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+47:14668:x1875263093871744:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 175us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.494803:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788390519.496368:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.496605:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093871872 00000100:00100000:2.0:1788390519.496625:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093871872 00000100:00100000:2.0:1788390519.496692:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788390519.496708:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+47:14668:x1875263093871872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.496732:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390519.496756:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33645 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0b9 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.496859:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.496874:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.496884:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390519.496926:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390519.496944:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.497001:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd33645 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b9 expref: 49 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.497029:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b9 expref: 48 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.497040:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:2.0:1788390519.497042:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788390519.497045:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd400, rc 0) 00000100:00100000:2.0:1788390519.497111:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+48:14668:x1875263093871872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 412us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390519.497117:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788390519.499680:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.499951:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872000 00000100:00100000:2.0:1788390519.499975:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872000 00000100:00100000:3.0:1788390519.500104:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390519.500115:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093872000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390519.500140:0:15043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390519.500218:0:15043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0c0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390519.500257:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac77, blocks: 0x1 00010000:00010000:1.0:1788390519.500282:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788390519.500288:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390519.500300:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.500323:0:15043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.500352:0:15043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62200, rc 0) 00000100:00100000:1.0:1788390519.500432:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+7:2356:x1875263093872000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 318us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.500440:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390519.502731:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.503015:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872256 00000100:00100000:0.0:1788390519.503028:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872256 00000100:00100000:0.0:1788390519.503105:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788390519.503118:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+48:14668:x1875263093872256:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788390519.503253:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+48:14668:x1875263093872256:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 136us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.503262:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:3.0:1788390519.505698:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.505833:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872384 00000100:00100000:1.0:1788390519.505846:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872384 00000100:00100000:1.0:1788390519.505917:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1788390519.505929:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+48:14668:x1875263093872384:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788390519.551998:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934651 is committed 00000004:00080000:2.0:1788390519.552020:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788390519.552042:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934659 is committed 00000020:00080000:2.0:1788390519.552069:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6875dff00 refcount 2 committed 0 result 0 batchid 4294967525 00000020:00080000:2.0:1788390519.552073:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f2a4000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6875dfcc0 00000020:00080000:2.0:1788390519.552076:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f2a4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5861af800 00000004:00080000:2.0:1788390519.552113:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788390519.552330:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103271680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788390519.552408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390519.552473:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390519.552477:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103271808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788390519.552504:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390519.552545:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271680 00000100:00100000:2.0:1788390519.552554:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271680 00000100:00100000:2.0:1788390519.552638:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103271808 00000100:00100000:2.0:1788390519.552642:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103271808 00000100:00100000:2.0:1788390519.552670:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390519.552680:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103271680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788390519.552711:0:16479:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:2.0:1788390519.552741:0:16479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.552763:0:16479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.552769:0:16479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788390519.552773:0:16479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390519.552777:0:16479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.552801:0:16479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.552812:0:16479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 7 pid: 15042 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390519.552821:0:16479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16479:1875263103271936:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390519.552878:0:16479:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390519.552892:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390519.552897:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103271808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788390519.553090:0:15042:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788390519.553095:0:15042:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788390519.553097:0:15042:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788390519.553099:0:15042:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788390519 -> 1788390519 00002000:00010000:2.0:1788390519.553102:0:15042:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788390519.553145:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103271808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (640us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788390519.553151:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788390519.553199:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d682f2bb80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788390519.553204:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103271808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788390519.553582:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:14668:x1875263093872384:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 47654us (47898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.553592:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000020:00080000:3.0:1788390519.553780:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967525 committed batchid 8 00000020:00080000:3.0:1788390519.554039:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788390519.556291:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390519.556350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.556480:0:16479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16479:1875263103271936:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788390519.556514:0:16479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.556778:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872512 00000100:00100000:0.0:1788390519.556788:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872512 00010000:00010000:0.0:1788390519.556839:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 8 pid: 15042 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.556906:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390519.556918:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2357:x1875263093872512:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390519.556939:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.556946:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 8 pid: 15042 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.556958:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 8 pid: 15042 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.557025:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd334b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff050 expref: 8 pid: 15042 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.557048:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390519.557051:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390519.557057:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.557065:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.557086:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390519.557165:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093872512:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 248us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.557174:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00010000:00010000:2.0:1788390519.557373:0:16479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.557383:0:16479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.557395:0:16479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.557404:0:16479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.557442:0:16479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788390519.558219:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103271680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5535us (5805us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788390519.558229:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:3.0:1788390519.558291:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d682f29180/2, rc 0, transno 8589934600 00000100:00100000:3.0:1788390519.558299:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103271680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788390519.558385:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872640 00000100:00100000:2.0:1788390519.558393:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872640 00010000:00010000:0.0:1788390519.558493:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390519.558502:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.558514:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390519.558519:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.558530:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.558550:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.558556:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3365a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.558577:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390519.558579:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390519.558581:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390519.559183:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788390519.559198:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093872640:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788390519.559313:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+7:2357:x1875263093872640:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 120us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.559319:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390519.562642:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.562729:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093872896 00000100:00100000:0.0:1788390519.562743:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093872896 00000100:00100000:0.0:1788390519.562812:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788390519.562822:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:14668:x1875263093872896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390519.562889:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.562920:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd3364c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b9 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.562990:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:0.0:1788390519.562995:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390519.563032:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.563044:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.563054:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390519.563352:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cd22bdd reply state 00000000626dc38d transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.563360:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390519.563672:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+15:14668:x1875263093872896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 848us (1050us total) trans 8589934660 rc 0/0 00000100:00100000:0.0:1788390519.563682:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00010000:00010000:1.0:1788390519.566740:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566763:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566773:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566812:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.566818:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566827:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566855:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:1.0:1788390519.566859:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390519.566865:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.566874:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c200/0x9aafc5f04cd33661 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390519.569637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.569700:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873024 00000100:00100000:2.0:1788390519.569717:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873024 00000100:00100000:2.0:1788390519.569834:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1788390519.569848:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+7:2356:x1875263093873024:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390519.570158:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788390519.570163:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788390518 00002000:00010000:2.0:1788390519.570166:0:15040:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788390518 00002000:00010000:2.0:1788390519.570169:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788390519 -> 1788390518 00002000:00010000:2.0:1788390519.570171:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788390519.570268:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+8:2356:x1875263093873024:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 422us (650us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788390519.570277:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390519.572249:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.572352:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873152 00000100:00100000:1.0:1788390519.572365:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873152 00000100:00100000:1.0:1788390519.572441:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788390519.572454:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2356:x1875263093873152:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788390519.572518:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572540:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390519.572546:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390519.572553:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572571:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572637:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572648:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572657:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572664:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390519.572669:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572680:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572699:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.572707:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd33668 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.572794:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2356:x1875263093873152:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 343us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.572811:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788390519.576225:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.576362:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873408 00000100:00100000:2.0:1788390519.576377:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873408 00000100:00100000:2.0:1788390519.576452:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788390519.576465:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:14668:x1875263093873408:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788390519.576668:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.576694:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.576730:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.577060:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.577073:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.577082:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.577131:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.577149:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 15 pid: 14355 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390519.577167:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272064:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788390519.577328:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390519.580395:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272064:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390519.580435:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390519.581819:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.582142:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873536 00000100:00100000:0.0:1788390519.582155:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873536 00010000:00010000:0.0:1788390519.582210:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 16 pid: 14355 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.582327:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390519.582364:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+16:2357:x1875263093873536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390519.582385:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.582394:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 16 pid: 14355 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.582408:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 16 pid: 14355 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.582435:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd3363e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0b2 expref: 16 pid: 14355 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.582457:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:0.0:1788390519.582462:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.582473:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.582482:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.584221:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390519.584327:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+15:2357:x1875263093873536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1960us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.584342:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00010000:00010000:2.0:1788390519.585797:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.585815:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390519.586173:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000001:00080000:2.0:1788390519.586362:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000001:00080000:2.0:1788390519.586397:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:2.0:1788390519.586512:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103272192:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788390519.586596:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390519.586650:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390519.586789:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103272192 00000100:00100000:3.0:1788390519.586800:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103272192 00000100:00100000:3.0:1788390519.586867:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390519.586878:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1875263103272192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788390519.587054:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1875263103272192:12345-0@lo:1000:mdt00_001.0 Request processed in 177us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390519.587063:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390519.587142:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103272192:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788390519.587997:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:0.0:1788390519.588092:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103272320:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788390519.588158:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390519.588188:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390519.589173:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103272320 00000100:00100000:2.0:1788390519.589184:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103272320 00000100:00100000:2.0:1788390519.589243:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390519.589265:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1875263103272320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788390519.589485:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14355:x1875263103272320:12345-0@lo:1000:mdt00_001.0 Request processed in 231us (1327us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788390519.589493:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390519.589717:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14355:1875263103272320:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788390519.589769:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589782:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589791:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589799:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390519.589804:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589812:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589832:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:0.0:1788390519.589836:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390519.589842:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589849:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd33676 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589879:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589886:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589920:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589926:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390519.589928:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589935:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.589943:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788390519.589947:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390519.589955:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.590003:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.590014:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.590051:0:14355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd335d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff096 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.590065:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272448:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390519.590157:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390519.594219:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272448:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390519.594282:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594294:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd335ce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594342:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594359:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594373:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594385:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594393:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594400:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594405:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390519.594410:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594418:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594431:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788390519.594434:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390519.594443:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594450:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd3367d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594460:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594466:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594485:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594492:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390519.594495:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594502:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594509:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788390519.594512:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390519.594514:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.594520:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc200/0x9aafc5f04cd3366f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.594878:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+18:14668:x1875263093873408:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 18414us (18665us total) trans 8589934665 rc 0/0 00000100:00100000:0.0:1788390519.594891:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000020:00080000:0.0:1788390519.594903:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788390519.595237:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390519.595243:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390519.596227:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390519.596239:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390519.597780:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390519.598671:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.599616:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873664 00000100:00100000:1.0:1788390519.599641:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873664 00000100:00100000:1.0:1788390519.599701:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093873920 00000100:00100000:1.0:1788390519.599764:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093873920 00000100:00100000:1.0:1788390519.599791:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390519.599803:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+19:14667:x1875263093873664:12345-192.168.202.1@tcp:49:bash.0 00000100:00100000:0.0:1788390519.599803:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788390519.599815:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788390519.600199:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+19:14667:x1875263093873664:12345-192.168.202.1@tcp:49:bash.0 Request processed in 397us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.600209:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390519.600230:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390519.600238:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+18:14668:x1875263093873920:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788390519.601053:0:14358:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788390519.601167:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00010000:00010000:1.0:1788390519.601212:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601232:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601243:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601250:0:14358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601257:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601275:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.601305:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390519.601342:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390519.601352:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.601360:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390519.601365:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.601375:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.601391:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff95d683b5a900) 00010000:00010000:2.0:1788390519.601395:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788390519.601402:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.601405:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+20:14668:x1875263093873920:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1163us (2734us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1788390519.601415:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000020:00080000:1.0:1788390519.601420:0:14358:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788390519.601422:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd33684 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390519.601436:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390519.601438:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390519.601439:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390519.606911:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.609317:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874048 00000100:00100000:1.0:1788390519.609343:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874048 00000100:00100000:1.0:1788390519.609508:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1788390519.609532:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+8:14667:x1875263093874048:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788390519.609557:0:15042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390519.609593:0:15042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0c7 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.609650:0:15042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 9 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.609661:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390519.609666:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390519.609672:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c7 expref: 9 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.609731:0:15042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 9 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.609772:0:15042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 9 pid: 15043 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.609792:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15042:1875263103272576:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390519.609930:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390519.613186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.613314:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874176 00000100:00100000:0.0:1788390519.613327:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874176 00010000:00010000:0.0:1788390519.613388:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 10 pid: 15043 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.613446:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788390519.613459:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+10:2356:x1875263093874176:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390519.613491:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.613534:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 10 pid: 15043 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.613552:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 10 pid: 15043 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.613596:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390519.613602:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390519.613613:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c7 expref: 10 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.613634:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c7 expref: 10 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.613689:0:14341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c7 expref: 10 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.613744:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14341:1875263103272704:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390519.613862:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390519.615178:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd33653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c0 expref: 10 pid: 15043 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.615205:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15042:1875263103272576:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390519.615245:0:15042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e2feeab/0x9aafc5f04cd3368b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0c7 expref: 9 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.615261:0:15042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390519.615324:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+9:14667:x1875263093874048:12345-192.168.202.1@tcp:101:bash.0 Request processed in 5804us (8426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.615333:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788390519.618858:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14341:1875263103272704:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390519.618895:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390519.619030:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2356:x1875263093874176:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 5571us (5859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.619044:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390519.622389:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.622615:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874432 00000100:00100000:0.0:1788390519.622642:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874432 00000100:00100000:0.0:1788390519.622763:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390519.622777:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+20:14667:x1875263093874432:12345-192.168.202.1@tcp:35:bash.0 00000001:00080000:0.0:1788390519.623658:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00000100:00100000:0.0:1788390519.623904:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c81d4476-fbab-45da-be95-db71a881e268+22:14667:x1875263093874432:12345-192.168.202.1@tcp:35:bash.0 Request processed in 1126us (1528us total) trans 8589934669 rc 0/0 00000100:00100000:0.0:1788390519.623928:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000020:00080000:0.0:1788390519.623935:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788390519.675451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.675795:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874560 00000100:00100000:2.0:1788390519.675809:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874560 00000100:00100000:2.0:1788390519.675950:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:2.0:1788390519.676008:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+22:14674:x1875263093874560:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390519.676040:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390519.676064:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0ce expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676235:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33699 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676258:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676273:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390519.676339:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390519.676343:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390519.676363:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33699 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676394:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc400/0x9aafc5f04cd33692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0ce expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676417:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd33699 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0ce expref: 23 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.676427:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390519.676430:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390519.676434:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62200, rc 0) 00000100:00100000:1.0:1788390519.676563:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+23:14674:x1875263093874560:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 602us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.676571:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390519.684243:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.684367:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874688 00000100:00100000:1.0:1788390519.684385:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874688 00000100:00100000:1.0:1788390519.684471:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390519.684484:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+23:14674:x1875263093874688:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390519.684527:0:16577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390519.684565:0:16577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd336a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0d5 expref: -99 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684679:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684712:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684725:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684749:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684758:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.684765:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687263:0:16577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687408:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687423:0:16577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390519.687496:0:16577:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:1.0:1788390519.687502:0:16577:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390519.687539:0:16577:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687554:0:16577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687579:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687587:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687595:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687602:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.687608:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687626:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687642:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390519.687646:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390519.687652:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687659:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd336a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687678:0:16577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687684:0:16577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687690:0:16577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687701:0:16577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.687890:0:16577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.687898:0:16577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.688639:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d683b5ad00) 00010000:00010000:1.0:1788390519.688646:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390519.688652:0:16577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.688664:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd336ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16577 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.688844:0:16577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd336a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 25 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.688861:0:16577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 24 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.688870:0:16577:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:1.0:1788390519.688873:0:16577:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390519.688876:0:16577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d683d44c00, rc 0) 00000100:00100000:1.0:1788390519.689260:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+24:14674:x1875263093874688:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4765us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.689582:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788390519.694315:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.694412:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093874944 00000100:00100000:0.0:1788390519.694434:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093874944 00000100:00100000:0.0:1788390519.694522:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788390519.694539:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+24:14674:x1875263093874944:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390519.694579:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390519.694608:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.695158:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.695174:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 25 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.695181:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.695218:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 25 pid: 16577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.695230:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 25 pid: 16577 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.695243:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103272832:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390519.695351:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390519.699094:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875263103272832:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390519.699145:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390519.700758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.701182:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875072 00000100:00100000:0.0:1788390519.701195:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875072 00010000:00010000:0.0:1788390519.701252:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 26 pid: 16577 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.701298:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390519.701328:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+26:2357:x1875263093875072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390519.701347:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.701357:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 26 pid: 16577 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701371:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 26 pid: 16577 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701399:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d683d44c00/0x9aafc5f04cd336b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0d5 expref: 26 pid: 16577 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701417:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788390519.701421:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701431:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701438:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.701472:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390519.701543:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c81d4476-fbab-45da-be95-db71a881e268+25:2357:x1875263093875072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 217us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.701548:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00010000:00010000:1.0:1788390519.701900:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.701917:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390519.701947:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788390519.702185:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 26 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.702204:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 25 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.702214:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:1.0:1788390519.702218:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390519.702220:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31c600, rc 0) 00000100:00100000:1.0:1788390519.702266:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+25:14674:x1875263093874944:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 7732us (7966us total) trans 8589934670 rc 0/0 00000100:00100000:1.0:1788390519.702275:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788390519.720581:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.721410:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875200 00000100:00100000:0.0:1788390519.721424:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875200 00000100:00100000:0.0:1788390519.721508:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1788390519.721522:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+25:14676:x1875263093875200:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390519.721581:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390519.721610:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd336d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff0e3 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721716:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721732:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721742:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721755:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721759:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.721764:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.722112:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.722137:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 26 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.722145:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.722191:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 26 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.722214:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 26 pid: 14354 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.722231:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272960:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390519.722330:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390519.723885:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.723914:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14355:1875263103272960:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390519.723943:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390519.724098:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875456 00000100:00100000:1.0:1788390519.724108:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875456 00000100:00100000:1.0:1788390519.724183:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788390519.724195:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+27:14280:x1875263093875456:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390519.724528:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c81d4476-fbab-45da-be95-db71a881e268+28:14280:x1875263093875456:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 325us (645us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1788390519.724537:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1788390519.727010:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390519.727241:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875584 00000100:00100000:0.0:1788390519.727254:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875584 00010000:00010000:0.0:1788390519.727300:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 28 pid: 14354 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390519.727356:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390519.727368:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+28:2356:x1875263093875584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390519.727385:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390519.727393:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 28 pid: 14354 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.727408:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 28 pid: 14354 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.727434:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c600/0x9aafc5f04cd336c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0dc expref: 28 pid: 14354 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.727939:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788390519.727944:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.727952:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.728003:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390519.728029:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390519.728095:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c81d4476-fbab-45da-be95-db71a881e268+27:2356:x1875263093875584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 730us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390519.728100:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00010000:00010000:1.0:1788390519.728234:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728241:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390519.728298:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:1.0:1788390519.728302:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390519.728321:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728333:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728343:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728349:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728356:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728363:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31ca00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.728368:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728376:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728387:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:1.0:1788390519.728390:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390519.728395:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728400:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31ca00/0x9aafc5f04cd336d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728418:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728422:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728426:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728428:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68f31c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390519.728430:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728433:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728438:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95d684d23700) 00010000:00010000:1.0:1788390519.728439:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390519.728441:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728444:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31c400/0x9aafc5f04cd336df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728704:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31dc00/0x9aafc5f04cd336d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0e3 expref: 27 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728721:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68f31d800/0x9aafc5f04cd336e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0e3 expref: 26 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390519.728740:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:1.0:1788390519.728743:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390519.728746:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68f31d800, rc 0) 00000100:00100000:1.0:1788390519.728789:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+26:14676:x1875263093875200:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 7269us (8222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.728797:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000001:00080000:2.0:1788390519.817100:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:2.0:1788390519.817125:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1788390519.817130:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:0.0:1788390519.885161:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390519.926017:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390519.926158:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875840 00000100:00100000:1.0:1788390519.926174:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875840 00000100:00100000:1.0:1788390519.926259:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1788390519.926272:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093875840:12345-192.168.202.1@tcp:16:kworker.0 00000100:00100000:1.0:1788390519.926467:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093875840:12345-192.168.202.1@tcp:16:kworker.0 Request processed in 197us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390519.926475:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390519.929005:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390519.930524:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875712 00000100:00100000:2.0:1788390519.930555:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875712 00002000:00100000:2.0:1788390519.930662:0:15046:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff95d682e96a00 x1875263093875712/t0(0) o4->c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp:135/0 lens 504/0 e 0 to 0 dl 1788390530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788390519.930700:0:15046:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96a00 with x1875263093875712 ext(0->12) 00002000:00010000:2.0:1788390519.930708:0:15046:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e96a00 00000100:00100000:2.0:1788390519.930756:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788390519.930767:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093875712:12345-192.168.202.1@tcp:4:bash.0 00000100:00100000:2.0:1788390519.931463:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c81d4476-fbab-45da-be95-db71a881e268+8:2359:x1875263093875712:12345-192.168.202.1@tcp:4:bash.0 Request processed in 695us (2586us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788390519.931473:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:2.0:1788390519.931481:0:15046:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff95d682e96a00 x1875263093875712/t8589934598(0) o4->c81d4476-fbab-45da-be95-db71a881e268@192.168.202.1@tcp:135/0 lens 504/448 e 0 to 0 dl 1788390530 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788390519.931490:0:15046:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96a00 with x1875263093875712 ext(0->12) 00002000:00010000:2.0:1788390519.931495:0:15046:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e96a00 00000040:00080000:1.0:1788390520.447255:0:16726:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390520.447270:0:16726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390520.447318:0:16726:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390520.447328:0:16726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390520.910580:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788390521.316844:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788390521.316872:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:1.0:1788390521.805262:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103273088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390521.805373:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390521.805573:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273088 00000100:00100000:0.0:1788390521.805584:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273088 00000100:00100000:0.0:1788390521.805683:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390521.805697:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103273088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390521.805729:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390521.805791:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103273088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390521.805800:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390521.805867:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788390521.805874:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d682f2bb80, transno 8589934595 00000004:00080000:0.0:1788390521.805888:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788390521.805922:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103273088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390521.806461:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390521.933769:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390521.972873:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390521.972914:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390521.972998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390521.973673:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876096 00000100:00100000:1.0:1788390521.973687:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876096 00000100:00100000:1.0:1788390521.973782:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390521.973794:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+26:2358:x1875263093876096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390521.973894:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+26:2358:x1875263093876096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 103us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390521.973900:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00080000:0.0:1788390521.974100:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390521.978149:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390521.978173:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390521.978313:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876352 00000100:00100000:2.0:1788390521.978325:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876352 00000100:00100000:2.0:1788390521.978423:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876608 00000100:00100000:2.0:1788390521.978426:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876608 00000100:00080000:0.0:1788390521.981732:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390521.981746:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390521.981938:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390521.981985:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390521.982012:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093875968 00000100:00100000:3.0:1788390521.982023:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093875968 00000100:00100000:3.0:1788390521.982073:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788390521.982081:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093875968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390521.982155:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093875968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390521.982161:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788390521.982385:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876224 00000100:00100000:0.0:1788390521.982389:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876224 00000100:00100000:0.0:1788390521.982419:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876736 00000100:00100000:0.0:1788390521.982421:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876736 00000100:00100000:0.0:1788390521.982433:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390521.982439:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2358:x1875263093876352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390521.982472:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2358:x1875263093876352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (9557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390521.982476:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390521.982487:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390521.982490:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2358:x1875263093876224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390521.982505:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+8:2358:x1875263093876224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (4331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390521.982508:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390521.982515:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390521.982518:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093876736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390521.982529:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093876736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 11us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390521.982533:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:0.0:1788390521.982541:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390521.982543:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390521.982561:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876480 00000100:00100000:0.0:1788390521.982579:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876480 00000100:00100000:0.0:1788390521.982621:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390521.982629:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093876480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390521.982664:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093876480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390521.982671:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00080000:0.0:1788390521.982687:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390521.983834:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788390521.983847:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093876608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390521.983899:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2358:x1875263093876608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390521.983905:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000040:00080000:1.0:1788390522.165794:0:16777:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390522.165811:0:16777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390522.165869:0:16777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390522.165875:0:16777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788390522.701576:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390522.701866:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390522.701921:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390522.701929:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390522.957227:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390523.897387:0:16829:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390523.897402:0:16829:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390523.897458:0:16829:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390523.897469:0:16829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390523.982099:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390524.365420:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103273472:0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.365522:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103273600:0@lo:400:kworker.0 00000100:00100000:2.0:1788390524.365534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390524.365603:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103273216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390524.365738:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273472 00000100:00100000:0.0:1788390524.365747:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273472 00000100:00100000:0.0:1788390524.365827:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390524.365839:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103273472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.373455:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390524.373651:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273600 00000100:00100000:1.0:1788390524.373664:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273600 00000100:00100000:1.0:1788390524.373736:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390524.373751:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103273600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.373846:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103273600:12345-0@lo:400:kworker.0 Request processed in 98us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390524.373856:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390524.373918:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103273600:0@lo:400:kworker.0 00000100:00080000:1.0:1788390524.373987:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390524.374020:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103273344:0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.374064:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390524.374099:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103273856:0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.374126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390524.374151:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390524.374158:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390524.374185:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390524.374236:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273856 00000100:00100000:1.0:1788390524.374241:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273856 00000100:00100000:1.0:1788390524.374282:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390524.374291:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103273856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.374336:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103273856:12345-0@lo:400:kworker.0 Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390524.374342:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390524.374362:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273984 00000100:00100000:1.0:1788390524.374366:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273984 00000100:00100000:1.0:1788390524.374395:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390524.374403:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103273984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390524.374439:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390524.374477:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103273984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390524.374484:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788390524.374507:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390524.374524:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934600 gen 2 00000004:00080000:1.0:1788390524.374531:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934600 00000004:00080000:1.0:1788390524.374553:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d682f29180, transno 8589934600 00000100:00100000:1.0:1788390524.374586:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390524.374601:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103273856:0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.375103:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273344 00000100:00100000:1.0:1788390524.375109:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273344 00000100:00100000:1.0:1788390524.375149:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390524.375157:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103273344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.375206:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103273344:12345-0@lo:400:kworker.0 Request processed in 50us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390524.375221:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788390524.375240:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390524.375263:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103273344:0@lo:400:kworker.0 00000100:00100000:0.0:1788390524.376088:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103273472:12345-0@lo:400:kworker.0 Request processed in 10246us (10548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390524.376099:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390524.380605:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103273472:0@lo:400:kworker.0 00000100:00100000:3.0:1788390524.380998:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390524.381058:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103273728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390524.381300:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390524.381413:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273216 00000100:00100000:0.0:1788390524.381424:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273216 00000100:00100000:0.0:1788390524.381564:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788390524.381758:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103273216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390524.381846:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103273216:12345-0@lo:400:kworker.0 Request processed in 270us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390524.381855:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390524.382022:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103273216:0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.383851:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103273728 00000100:00100000:1.0:1788390524.383871:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103273728 00000100:00100000:1.0:1788390524.384004:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390524.384017:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103273728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390524.384131:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103273728:12345-0@lo:400:kworker.0 Request processed in 117us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390524.384139:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788390524.384442:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390524.384551:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103273728:0@lo:400:kworker.0 00000001:00080000:1.0:1788390524.931671:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934669 is committed 00000020:00080000:1.0:1788390524.931701:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a22840 refcount 2 committed 0 result 0 batchid 4294967526 00000020:00080000:1.0:1788390524.931708:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a69d6000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a223c0 00000020:00080000:1.0:1788390524.931713:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a69d6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d6bc6b8400 00000001:00080000:1.0:1788390524.931743:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934671 is committed 00000020:00080000:1.0:1788390524.931785:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967525 batchid updated 00000020:00080000:3.0:1788390524.931890:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967526 committed batchid 4294967525 00000020:00080000:3.0:1788390524.932158:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967525 00000001:00080000:3.0:1788390524.935843:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:2.0:1788390525.007930:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390525.544560:0:16881:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390525.544582:0:16881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390525.544634:0:16881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390525.544642:0:16881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390526.029341:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390526.926148:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390526.926225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390526.926354:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274112 00000100:00100000:1.0:1788390526.926363:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274112 00000100:00100000:1.0:1788390526.926426:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390526.926436:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390526.926468:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788390526.926544:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390526.928658:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2215us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390526.928670:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390526.930856:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390527.055245:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390527.092726:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390527.092768:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390527.092795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390527.092799:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876864 00000100:00100000:0.0:1788390527.092811:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876864 00000100:00100000:3.0:1788390527.092819:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390527.092862:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788390527.092874:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093876864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390527.092882:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390527.092909:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877376 00000100:00100000:3.0:1788390527.092913:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877376 00000100:00100000:3.0:1788390527.092948:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093876992 00000100:00100000:3.0:1788390527.092951:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093876992 00000100:00100000:0.0:1788390527.092987:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093876864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 114us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390527.092996:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1788390527.093039:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390527.093048:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093877376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390527.093077:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093877376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390527.093081:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390527.093091:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390527.093096:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093876992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390527.093119:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093876992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390527.093127:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390527.093149:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877120 00000100:00100000:3.0:1788390527.093154:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877120 00000100:00100000:3.0:1788390527.093180:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877248 00000100:00100000:0.0:1788390527.093198:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390527.093199:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877248 00000100:00100000:0.0:1788390527.093212:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093877120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390527.093232:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390527.093241:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2357:x1875263093877248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390527.093251:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093877120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390527.093259:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390527.093267:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2357:x1875263093877248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390527.093272:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00080000:3.0:1788390527.093290:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390527.093294:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390527.093296:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390527.097047:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390527.097077:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390527.097150:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877504 00000100:00100000:1.0:1788390527.097172:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877504 00000100:00100000:0.0:1788390527.097244:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877632 00000100:00100000:0.0:1788390527.097250:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877632 00000100:00100000:1.0:1788390527.097379:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1788390527.097391:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2355:x1875263093877504:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:1.0:1788390527.097421:0:15042:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd330d4 00000100:00080000:1.0:1788390527.097443:0:15042:0:(import.c:65:import_set_state_nolock()) ffff95d5810c8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390527.097493:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00010000:00010000:3.0:1788390527.097519:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390527.098136:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+2:2355:x1875263093877504:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 746us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390527.098145:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00080000:2.0:1788390527.098455:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390527.098522:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390527.098910:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788390527.098918:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+5:2355:x1875263093877632:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1788390527.098935:0:16479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd330db 00000100:00080000:0.0:1788390527.098945:0:16479:0:(import.c:65:import_set_state_nolock()) ffff95d5810ce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390527.099000:0:16479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788390527.099207:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+2:2355:x1875263093877632:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 288us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390527.099213:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00010000:00010000:2.0:1788390527.099823:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390527.203348:0:16932:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390527.203357:0:16932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390527.203416:0:16932:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390527.203422:0:16932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390528.077220:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390528.755741:0:16983:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390528.755751:0:16983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390528.755797:0:16983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390528.755805:0:16983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390529.101131:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390529.485571:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390529.485605:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274624:0@lo:400:kworker.0 00000100:00100000:0.0:1788390529.485671:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390529.485693:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103274496:0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.485722:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274624 00000100:00100000:3.0:1788390529.485730:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274624 00000100:00100000:2.0:1788390529.485735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390529.485741:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390529.485759:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103275008:0@lo:400:kworker.0 00000100:00100000:0.0:1788390529.485776:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390529.485798:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274496 00000100:00100000:2.0:1788390529.485799:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390529.485804:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390529.485805:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274496 00000100:00100000:0.0:1788390529.485817:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103274752:0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.485828:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788390529.485837:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103274368:0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.485844:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390529.485849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390529.485861:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.485872:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390529.485890:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390529.485900:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.485919:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103274880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.485936:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274624:12345-0@lo:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390529.485947:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390529.485947:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103274496:12345-0@lo:400:kworker.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390529.485954:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390529.485984:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788390529.486004:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390529.486010:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390529.486016:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103274496:0@lo:400:kworker.0 00000100:00100000:0.0:1788390529.486031:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275008 00000100:00100000:0.0:1788390529.486035:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275008 00000100:00100000:3.0:1788390529.486052:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274752 00000100:00100000:3.0:1788390529.486058:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274752 00000100:00100000:2.0:1788390529.486292:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274368 00000100:00100000:2.0:1788390529.486297:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274368 00000100:00100000:2.0:1788390529.486329:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788390529.486392:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274880 00000100:00100000:0.0:1788390529.486396:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274880 00000100:00100000:2.0:1788390529.486399:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.486425:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390529.486433:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390529.486438:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103275008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390529.486445:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103274752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.486454:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103274368:12345-0@lo:400:kworker.0 Request processed in 117us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390529.486462:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788390529.486492:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103275008:12345-0@lo:400:kworker.0 Request processed in 57us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390529.486495:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103274752:12345-0@lo:400:kworker.0 Request processed in 52us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390529.486500:0:16577:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788390529.486505:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788390529.486512:0:16577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788390529.486512:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390529.486539:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390529.486550:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103274880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.486580:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103274880:12345-0@lo:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390529.486586:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390529.486609:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103274240 00000100:00100000:3.0:1788390529.486613:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103274240 00000100:00080000:0.0:1788390529.486641:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390529.486646:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390529.486653:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390529.486682:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390529.486683:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103274752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390529.486697:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788390529.486725:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103274240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390529.486733:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103274240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390529.486734:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390529.486788:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.486803:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103274880:0@lo:400:kworker.0 00000100:00100000:2.0:1788390529.486812:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103275008:0@lo:400:kworker.0 00000020:00080000:1.0:1788390530.027715:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967526 batchid updated 00000020:00080000:0.0:1788390530.027775:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967526 00000020:00080000:0.0:1788390530.027788:0:14394:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967526 00000001:00100000:2.0:1788390530.029941:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000020:00000080:2.0:1788390530.029947:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d5810cd800/fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000020:00000080:1.0:1788390530.030050:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5810cd800/fca61cce-adf5-4b9d-82ab-6877bfc57d88 for lustre-OST0000 00000020:00000080:1.0:1788390530.030174:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5810c8800 for lustre-OST0000 00010000:00010000:1.0:1788390530.125447:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390530.319196:0:17039:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390530.319207:0:17039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390530.319260:0:17039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390530.319270:0:17039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390531.152306:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390531.572892:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000020:00000080:1.0:1788390531.572903:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d5810c9800/fca61cce-adf5-4b9d-82ab-6877bfc57d88 00000020:00000080:1.0:1788390531.572945:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5810c9800/fca61cce-adf5-4b9d-82ab-6877bfc57d88 for lustre-OST0001 00000020:00000080:1.0:1788390531.573089:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5810ce000 for lustre-OST0001 00000040:00080000:2.0:1788390531.981948:0:17092:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390531.981957:0:17092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390531.982032:0:17092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390531.982038:0:17092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390532.045193:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103275136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390532.045262:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390532.045342:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275136 00000100:00100000:3.0:1788390532.045350:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275136 00000100:00100000:3.0:1788390532.045407:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390532.045418:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103275136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390532.045460:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390532.045670:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103275136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390532.045678:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788390532.045700:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390532.045756:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103275136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390532.176249:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390532.217097:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390532.217160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390532.217187:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877888 00000100:00100000:0.0:1788390532.217198:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877888 00000100:00100000:3.0:1788390532.217199:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390532.217242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390532.217313:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878016 00000100:00100000:2.0:1788390532.217317:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878016 00000100:00100000:2.0:1788390532.217352:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390532.217361:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093878016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390532.217424:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093878016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390532.217431:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1788390532.217594:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093877760 00000100:00100000:1.0:1788390532.217599:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093877760 00000100:00100000:1.0:1788390532.217630:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788390532.217636:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093877760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390532.217666:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093877760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390532.217683:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00080000:1.0:1788390532.217716:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390532.217720:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390532.218146:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878272 00000100:00100000:0.0:1788390532.218151:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878272 00000100:00100000:0.0:1788390532.218178:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390532.218184:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093877888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390532.218218:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093877888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390532.218225:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390532.218236:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788390532.218241:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093878272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390532.218258:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093878272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390532.218263:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00080000:1.0:1788390532.218795:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390532.219120:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390532.219462:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878144 00000100:00100000:1.0:1788390532.219468:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878144 00000100:00100000:1.0:1788390532.219558:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1788390532.219568:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2359:x1875263093878144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390532.219658:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+5:2359:x1875263093878144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390532.219664:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00080000:3.0:1788390532.220228:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788390532.941345:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390532.941355:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390532.941423:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390532.941432:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390533.197181:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390533.624009:0:17143:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390533.624021:0:17143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390533.624076:0:17143:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390533.624085:0:17143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390534.222600:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390534.605648:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103275520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390534.605682:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103275392:0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.605735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390534.605764:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390534.605821:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103276032:0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.605856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390534.605864:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103275264:0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.605907:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276032 00000100:00100000:2.0:1788390534.605917:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276032 00000100:00100000:1.0:1788390534.605927:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390534.606023:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103275648:0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.606053:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390534.606067:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390534.606074:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.606135:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103276032:12345-0@lo:400:kworker.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390534.606142:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390534.606202:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103276032:0@lo:400:kworker.0 00000100:00080000:2.0:1788390534.606236:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390534.606247:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275520 00000100:00100000:2.0:1788390534.606250:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275520 00000100:00100000:2.0:1788390534.606278:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390534.606284:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103275520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390534.606309:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390534.606339:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103275520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390534.606345:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788390534.606355:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390534.606433:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103275904:0@lo:400:kworker.0 00000100:00100000:0.0:1788390534.606472:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390534.609766:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103275520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390534.609768:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103275776:0@lo:400:kworker.0 00000100:00100000:1.0:1788390534.609877:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390534.609889:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275392 00000100:00100000:2.0:1788390534.609900:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275392 00000100:00100000:1.0:1788390534.610011:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275264 00000100:00100000:2.0:1788390534.610014:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275648 00000100:00100000:1.0:1788390534.610019:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275264 00000100:00100000:2.0:1788390534.610034:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275648 00000100:00100000:1.0:1788390534.610084:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390534.610093:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390534.610102:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103275264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.610117:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103275392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390534.610167:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103275264:12345-0@lo:400:kworker.0 Request processed in 68us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390534.610190:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788390534.610234:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390534.610243:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103275648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390534.610277:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103275648:12345-0@lo:400:kworker.0 Request processed in 36us (4213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390534.610283:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390534.610336:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103275264:0@lo:400:kworker.0 00000100:00100000:1.0:1788390534.610375:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275904 00000100:00100000:1.0:1788390534.610380:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275904 00000100:00100000:1.0:1788390534.610419:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103275776 00000100:00100000:1.0:1788390534.610422:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103275776 00000100:00100000:1.0:1788390534.610436:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390534.610442:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103275904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390534.610471:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103275392:12345-0@lo:400:kworker.0 Request processed in 357us (4708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390534.610492:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390534.610508:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103275904:12345-0@lo:400:kworker.0 Request processed in 63us (4034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390534.610517:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390534.610536:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390534.610546:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103275776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788390534.610559:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390534.610566:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390534.610604:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103275776:12345-0@lo:400:kworker.0 Request processed in 59us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390534.610614:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390534.610656:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103275776:0@lo:400:kworker.0 00000100:00100000:0.0:1788390534.610840:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103275904:0@lo:400:kworker.0 00000100:00100000:0.0:1788390534.610864:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103275392:0@lo:400:kworker.0 00000100:00100000:3.0:1788390534.618841:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103275648:0@lo:400:kworker.0 00000040:00080000:1.0:1788390535.212303:0:17195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390535.212314:0:17195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390535.212361:0:17195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390535.212373:0:17195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390535.245330:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390536.269401:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390536.804460:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390536.804480:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390536.804527:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390536.804535:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390537.165837:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390537.165857:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103276160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390537.165915:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390537.166105:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276160 00000100:00100000:2.0:1788390537.166113:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276160 00000100:00100000:2.0:1788390537.166168:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390537.166175:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103276160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390537.166203:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390537.166251:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103276160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390537.166255:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788390537.166320:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390537.166321:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103276160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390537.293269:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390537.335056:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390537.335094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390537.335121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390537.335147:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390537.335166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390537.335237:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878656 00000100:00100000:1.0:1788390537.335246:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878656 00000100:00100000:1.0:1788390537.335302:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878784 00000100:00100000:1.0:1788390537.335305:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878784 00000100:00100000:1.0:1788390537.335323:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788390537.335332:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093878656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390537.335413:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093878656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390537.335421:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788390537.335436:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788390537.335442:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093878784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390537.335476:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+5:2356:x1875263093878784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390537.335482:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390537.335636:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878912 00000100:00100000:3.0:1788390537.335640:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878912 00000100:00100000:3.0:1788390537.335675:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878528 00000100:00100000:3.0:1788390537.335677:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878528 00000100:00100000:3.0:1788390537.335695:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788390537.335700:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093878912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390537.335731:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093878912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390537.335737:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788390537.335747:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788390537.335765:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093878528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390537.335784:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093878528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390537.335789:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00080000:0.0:1788390537.335939:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390537.335944:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390537.335946:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390537.336057:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093878400 00000100:00100000:2.0:1788390537.336061:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093878400 00000100:00100000:2.0:1788390537.336126:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1788390537.336133:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093878400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390537.336158:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093878400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390537.336173:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00010000:00010000:3.0:1788390538.319169:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390538.405316:0:17298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390538.405325:0:17298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390538.405364:0:17298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390538.405370:0:17298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390539.341796:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390539.725551:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.725633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390539.725695:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788390539.725702:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103276288:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.725731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390539.725758:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103276800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.725789:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390539.725821:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276288 00000100:00100000:0.0:1788390539.725829:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276288 00000100:00100000:2.0:1788390539.725846:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103276416:0@lo:400:kworker.0 00000100:00100000:2.0:1788390539.725877:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390539.725883:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788390539.725892:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103276288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390539.725895:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103276928:0@lo:400:kworker.0 00000100:00100000:2.0:1788390539.725929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390539.725943:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103276288:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390539.725950:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788390539.726018:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276672 00000100:00100000:0.0:1788390539.726022:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276672 00000100:00100000:0.0:1788390539.726048:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276800 00000100:00100000:0.0:1788390539.726051:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276800 00000100:00100000:0.0:1788390539.726094:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276928 00000100:00100000:0.0:1788390539.726097:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276928 00000100:00100000:0.0:1788390539.726111:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390539.726116:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103276672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726149:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103276672:12345-0@lo:400:kworker.0 Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390539.726154:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390539.726166:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390539.726172:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103276800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726198:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103276800:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390539.726204:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390539.726215:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390539.726221:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103276928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390539.726260:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103276928:0@lo:400:kworker.0 00000100:00100000:2.0:1788390539.726272:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390539.726290:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103276544:0@lo:400:kworker.0 00000100:00100000:3.0:1788390539.726495:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390539.726539:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103276928:12345-0@lo:400:kworker.0 Request processed in 318us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390539.726545:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788390539.726569:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390539.726590:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103276288:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726600:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103276800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726616:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726676:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276416 00000100:00100000:0.0:1788390539.726680:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276416 00000100:00100000:0.0:1788390539.726712:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390539.726719:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103276416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390539.726757:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103276416:12345-0@lo:400:kworker.0 Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390539.726763:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788390539.726776:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390539.728209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390539.728248:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103276544 00000100:00100000:1.0:1788390539.728255:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103276544 00000100:00100000:2.0:1788390539.728266:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103276416:0@lo:400:kworker.0 00000100:00100000:1.0:1788390539.728312:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390539.728320:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103276544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390539.728369:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103276544:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390539.728376:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390539.728389:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103276544:0@lo:400:kworker.0 00000100:00080000:1.0:1788390539.728393:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390539.728618:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390539.728765:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277056 00000100:00100000:2.0:1788390539.728770:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277056 00000100:00100000:2.0:1788390539.728802:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390539.728809:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103277056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390539.728837:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390539.728876:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103277056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390539.729074:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390539.729425:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000040:00080000:1.0:1788390540.028945:0:17349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390540.028955:0:17349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390540.029170:0:17349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390540.029177:0:17349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390540.366474:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390541.390288:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390541.667005:0:17400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390541.667016:0:17400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390541.667061:0:17400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390541.667067:0:17400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788390542.157209:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390542.157230:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390542.157576:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390542.157584:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390542.288682:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390542.289159:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390542.289220:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390542.289455:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277184 00000100:00100000:3.0:1788390542.289464:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277184 00000100:00080000:0.0:1788390542.289506:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390542.289540:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390542.289550:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103277184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390542.289587:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390542.289632:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103277184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390542.289638:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390542.291579:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103277184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390542.413402:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390542.457738:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390542.457783:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390542.457894:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879040 00000100:00100000:2.0:1788390542.457905:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879040 00000100:00100000:2.0:1788390542.457994:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1788390542.458005:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093879040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390542.458075:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093879040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390542.458083:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1788390542.458448:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390542.458990:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879168 00000100:00100000:2.0:1788390542.458997:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879168 00000100:00100000:2.0:1788390542.459046:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788390542.459056:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093879168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390542.459103:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093879168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390542.459110:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00080000:0.0:1788390542.460155:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390542.464750:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879296 00000100:00100000:1.0:1788390542.464766:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879296 00000100:00100000:1.0:1788390542.465038:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390542.465050:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093879296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390542.465137:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093879296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 90us (7353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390542.465143:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00080000:0.0:1788390542.466525:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390542.468710:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390542.473469:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879424 00000100:00100000:1.0:1788390542.473485:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879424 00000100:00100000:1.0:1788390542.473595:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788390542.473607:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+5:2355:x1875263093879424:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:1.0:1788390542.473647:0:16479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd330a3 00000100:00080000:1.0:1788390542.473671:0:16479:0:(import.c:65:import_set_state_nolock()) ffff95d68f2cc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390542.473708:0:16479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788390542.474011:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+2:2355:x1875263093879424:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 404us (5311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390542.474019:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00010000:00010000:0.0:1788390542.474694:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390542.474704:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390542.475498:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390542.475643:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879552 00000100:00100000:0.0:1788390542.475651:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879552 00000100:00100000:0.0:1788390542.475746:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390542.475756:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093879552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390542.475819:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093879552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390542.475826:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00080000:1.0:1788390542.475989:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788390543.406306:0:17452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390543.406316:0:17452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390543.406363:0:17452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390543.406369:0:17452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390543.437160:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390544.461110:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390544.846091:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103277440:0@lo:400:kworker.0 00000100:00100000:2.0:1788390544.846162:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390544.846222:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103277312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390544.846248:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390544.846286:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277440 00000100:00100000:3.0:1788390544.846302:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277440 00000100:00100000:3.0:1788390544.846352:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788390544.846361:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103277440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390544.846520:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103277440:12345-0@lo:400:kworker.0 Request processed in 160us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390544.846528:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390544.846639:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103277568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.846670:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.846692:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390544.846698:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103277696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.846718:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.846748:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103277824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.846771:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.846796:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277824 00000100:00100000:0.0:1788390544.846799:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277824 00000100:00100000:0.0:1788390544.846988:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390544.846996:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103277824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.847032:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fd03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103277824:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390544.847037:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390544.847073:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103277824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.847123:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277568 00000100:00100000:0.0:1788390544.847126:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277568 00000100:00100000:0.0:1788390544.847157:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277696 00000100:00100000:0.0:1788390544.847160:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277696 00000100:00100000:0.0:1788390544.847180:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390544.847187:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103277568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.847220:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103277568:12345-0@lo:400:kworker.0 Request processed in 34us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390544.847227:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390544.847361:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390544.847368:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103277696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.847409:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103277696:12345-0@lo:400:kworker.0 Request processed in 41us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390544.847414:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788390544.847430:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390544.847434:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390544.847456:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103277696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.847473:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103277568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.848589:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390544.848605:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103278080:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.848662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.848732:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390544.848741:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103277952:0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.848763:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390544.848853:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103277440:0@lo:400:kworker.0 00000100:00100000:2.0:1788390544.848884:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277312 00000100:00100000:2.0:1788390544.848889:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277312 00000100:00100000:2.0:1788390544.848922:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390544.848929:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103277312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390544.848975:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390544.849016:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103277312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390544.849022:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390544.849060:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103277312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390544.849554:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278080 00000100:00100000:1.0:1788390544.849559:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278080 00000100:00100000:1.0:1788390544.849635:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103277952 00000100:00100000:1.0:1788390544.849639:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103277952 00000100:00080000:2.0:1788390544.849670:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390544.849708:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390544.849716:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103278080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390544.849765:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103278080:12345-0@lo:400:kworker.0 Request processed in 50us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390544.849772:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390544.849858:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103278080:0@lo:400:kworker.0 00000100:00100000:1.0:1788390544.850356:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390544.850363:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103277952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390544.850415:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103277952:12345-0@lo:400:kworker.0 Request processed in 52us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390544.850421:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390544.850785:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103277952:0@lo:400:kworker.0 00000040:00080000:0.0:1788390545.029641:0:17503:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390545.029652:0:17503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390545.030425:0:17503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390545.030432:0:17503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390545.485194:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390546.509819:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390546.652940:0:17556:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390546.652948:0:17556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390546.653005:0:17556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390546.653011:0:17556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00100000:0.0:1788390546.912252:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c81d4476-fbab-45da-be95-db71a881e268 00000020:00000080:0.0:1788390546.912262:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d68f2cb000/c81d4476-fbab-45da-be95-db71a881e268 00000020:00000080:3.0:1788390546.912322:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f2cb000/c81d4476-fbab-45da-be95-db71a881e268 for lustre-OST0001 00000020:00000080:3.0:1788390546.912396:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f2cc800 for lustre-OST0001 00000100:00100000:1.0:1788390547.405258:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390547.405280:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103278208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390547.405342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390547.405725:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278208 00000100:00100000:3.0:1788390547.405735:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278208 00000100:00100000:3.0:1788390547.405820:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390547.405831:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103278208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390547.405871:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390547.405929:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103278208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390547.405936:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390547.406014:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103278208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390547.406067:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390547.533097:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390547.577167:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390547.577209:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390547.577221:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879680 00000100:00100000:3.0:1788390547.577232:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879680 00000100:00100000:2.0:1788390547.577319:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390547.577357:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1788390547.577828:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390547.577855:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093879680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390547.577866:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879808 00000100:00100000:0.0:1788390547.577872:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879808 00000100:00100000:0.0:1788390547.577913:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880064 00000100:00100000:0.0:1788390547.577916:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880064 00000100:00100000:3.0:1788390547.577937:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093879680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 568us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390547.577943:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788390547.577950:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1788390547.577956:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093879808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390547.578024:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093879808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 67us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390547.578045:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390547.578059:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390547.578064:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093880064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390547.578085:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093880064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390547.578091:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390547.578106:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093879936 00000100:00100000:0.0:1788390547.578109:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093879936 00000100:00100000:0.0:1788390547.578135:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788390547.578142:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093879936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390547.578173:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093879936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390547.578179:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00080000:0.0:1788390547.578202:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390547.578206:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788390548.264878:0:17608:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390548.264891:0:17608:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390548.264942:0:17608:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390548.264953:0:17608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390548.557187:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390549.581106:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390549.921949:0:17659:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390549.922335:0:17659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390549.922402:0:17659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390549.922409:0:17659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390549.965733:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103278336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390549.966606:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.966838:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278336 00000100:00100000:3.0:1788390549.966847:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278336 00000100:00100000:3.0:1788390549.966901:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390549.966911:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103278336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390549.966948:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390549.967024:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103278336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390549.967043:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390549.974092:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103278720:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.974167:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.974234:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390549.974240:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103278592:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.974267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.974308:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278592 00000100:00100000:2.0:1788390549.974315:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278592 00000100:00100000:2.0:1788390549.974377:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390549.974387:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103278592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.974438:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103278592:12345-0@lo:400:kworker.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.974446:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390549.974489:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103278592:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.978641:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103278464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.978728:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390549.978773:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.978804:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390549.978854:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390549.978869:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103278848:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.978895:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390549.978945:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278464 00000100:00100000:1.0:1788390549.978953:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278464 00000100:00100000:1.0:1788390549.979015:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788390549.979025:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103278464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979077:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103278464:12345-0@lo:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.979085:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788390549.979122:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278720 00000100:00100000:1.0:1788390549.979126:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278720 00000100:00100000:1.0:1788390549.979151:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278976 00000100:00100000:1.0:1788390549.979154:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278976 00000100:00100000:1.0:1788390549.979175:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103278848 00000100:00100000:1.0:1788390549.979178:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103278848 00000100:00100000:1.0:1788390549.979268:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390549.979277:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979321:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103278720:12345-0@lo:400:kworker.0 Request processed in 45us (5154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.979327:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390549.979339:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390549.979355:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103278976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979381:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103278976:12345-0@lo:400:kworker.0 Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.979387:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390549.979400:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788390549.979405:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979440:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103278848:12345-0@lo:400:kworker.0 Request processed in 35us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.979446:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788390549.979496:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103278720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979526:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103278848:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979535:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103278464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.979544:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103278976:0@lo:400:kworker.0 00000100:00080000:0.0:1788390549.981428:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390549.981437:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390549.981440:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390549.981493:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103278336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788390550.610366:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390551.489123:0:17710:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390551.489132:0:17710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390551.489193:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390551.489206:0:17710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390551.629211:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390552.398661:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390552.398671:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390552.398706:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390552.398713:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390552.525517:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390552.525540:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103279104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390552.525613:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390552.525957:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279104 00000100:00100000:3.0:1788390552.525992:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279104 00000100:00100000:3.0:1788390552.526056:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390552.526067:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103279104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390552.526102:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390552.526154:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103279104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390552.526161:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390552.526206:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103279104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390552.527251:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390552.660216:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390552.694481:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390552.694514:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390552.694542:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390552.694570:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390552.694604:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880192 00000100:00100000:0.0:1788390552.694604:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880448 00000100:00100000:3.0:1788390552.694614:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880192 00000100:00100000:0.0:1788390552.694614:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880448 00000100:00100000:3.0:1788390552.694664:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:0.0:1788390552.694674:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788390552.694677:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093880192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390552.694688:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093880448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390552.694772:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093880192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390552.694772:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093880448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390552.694788:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788390552.694789:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00080000:0.0:1788390552.694815:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390552.694987:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880320 00000100:00100000:1.0:1788390552.694992:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880320 00000100:00100000:1.0:1788390552.695039:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880576 00000100:00100000:1.0:1788390552.695043:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880576 00000100:00100000:1.0:1788390552.695066:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788390552.695072:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093880320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390552.695109:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093880320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390552.695115:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788390552.695127:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390552.695134:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093880576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390552.695156:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093880576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390552.695162:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00080000:0.0:1788390552.695556:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788390553.093720:0:17763:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390553.093729:0:17763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390553.093769:0:17763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390553.093774:0:17763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390553.678089:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390554.702043:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390554.732332:0:17814:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390554.732342:0:17814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390554.732390:0:17814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390554.732401:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390555.085444:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103279360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.085518:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.085576:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103279872:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.085601:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.085627:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390555.085632:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103279488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.085650:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.085696:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279872 00000100:00100000:1.0:1788390555.085703:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279872 00000100:00100000:1.0:1788390555.085762:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390555.085773:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103279872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.085824:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103279872:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.085831:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390555.085854:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279360 00000100:00100000:1.0:1788390555.085857:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279360 00000100:00100000:1.0:1788390555.085879:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279488 00000100:00100000:1.0:1788390555.085882:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279488 00000100:00100000:1.0:1788390555.085900:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390555.085906:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103279360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.085934:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103279360:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.085940:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390555.085951:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390555.085956:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103279488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.086006:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103279488:12345-0@lo:400:kworker.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.086027:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788390555.086044:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390555.086049:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390555.086051:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390555.086083:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103279488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.086094:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103279360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.086101:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103279872:0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086248:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103279616:0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390555.086317:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788390555.086331:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103279232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086358:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390555.086390:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103279744:0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086411:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390555.086436:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279616 00000100:00100000:2.0:1788390555.086439:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279616 00000100:00100000:2.0:1788390555.086461:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279744 00000100:00100000:2.0:1788390555.086464:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279744 00000100:00100000:2.0:1788390555.086488:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390555.086494:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103279616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086529:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103279616:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390555.086536:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390555.086549:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788390555.086554:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103279744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086578:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103279744:12345-0@lo:400:kworker.0 Request processed in 24us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390555.086583:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788390555.086597:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390555.086615:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103279744:0@lo:400:kworker.0 00000100:00100000:2.0:1788390555.086624:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103279616:0@lo:400:kworker.0 00000100:00100000:3.0:1788390555.086695:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103279232 00000100:00100000:3.0:1788390555.086699:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103279232 00000100:00100000:3.0:1788390555.086733:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788390555.086740:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103279232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390555.086786:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103279232:12345-0@lo:400:kworker.0 Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390555.086792:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788390555.086831:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103279232:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.087155:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103280000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390555.087185:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390555.087258:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280000 00000100:00100000:3.0:1788390555.087262:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280000 00000100:00100000:3.0:1788390555.087294:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390555.087309:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103280000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390555.087339:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390555.087371:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103280000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390555.087376:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390555.087488:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103280000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788390555.725527:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390556.494403:0:17865:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390556.494412:0:17865:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390556.494455:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390556.494464:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390556.758826:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390557.645649:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103280128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390557.645732:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390557.645855:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280128 00000100:00100000:0.0:1788390557.645864:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280128 00000100:00080000:1.0:1788390557.645920:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390557.645941:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390557.645952:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103280128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390557.646014:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390557.646059:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103280128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390557.646092:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390557.646100:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103280128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390557.773085:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390557.813569:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390557.813599:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390557.813624:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390557.813641:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880832 00000100:00100000:2.0:1788390557.813650:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880832 00000100:00100000:3.0:1788390557.813655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390557.813687:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390557.813740:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881088 00000100:00100000:2.0:1788390557.813745:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881088 00000100:00100000:3.0:1788390557.813763:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1788390557.813777:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093880832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390557.813785:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1788390557.813796:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093881088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390557.813854:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093880832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390557.813870:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1788390557.813893:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880704 00000100:00100000:0.0:1788390557.813898:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880704 00000100:00100000:1.0:1788390557.813925:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093880960 00000100:00100000:1.0:1788390557.813928:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093880960 00000100:00100000:1.0:1788390557.813953:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788390557.813957:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093880960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390557.814047:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1788390557.814052:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093880704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390557.814188:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093881088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 395us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390557.814193:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00080000:2.0:1788390557.814208:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390557.814210:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390557.814334:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093880960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 375us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390557.814351:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788390557.814438:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093880704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 384us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390557.814445:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000040:00080000:1.0:1788390558.236780:0:17916:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390558.236787:0:17916:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390558.236833:0:17916:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390558.236838:0:17916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390558.801277:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390559.822081:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390559.832947:0:17968:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390559.832956:0:17968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390559.833025:0:17968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390559.833033:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390560.205216:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390560.205242:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103280640:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390560.205412:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103280256:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205442:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390560.205468:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390560.205473:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103280768:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390560.205523:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280640 00000100:00100000:3.0:1788390560.205527:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280256 00000100:00100000:1.0:1788390560.205532:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280640 00000100:00100000:3.0:1788390560.205533:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280256 00000100:00100000:1.0:1788390560.205586:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280768 00000100:00100000:3.0:1788390560.205589:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390560.205591:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280768 00000100:00100000:3.0:1788390560.205600:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103280256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390560.205634:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390560.205644:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103280640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205665:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103280256:12345-0@lo:400:kworker.0 Request processed in 65us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390560.205674:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390560.205692:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103280640:12345-0@lo:400:kworker.0 Request processed in 49us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390560.205701:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788390560.205714:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390560.205724:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103280768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205755:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103280768:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390560.205759:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390560.205799:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103280768:0@lo:400:kworker.0 00000100:00080000:2.0:1788390560.205810:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390560.205814:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103280640:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.205826:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103280256:0@lo:400:kworker.0 00000100:00100000:0.0:1788390560.206066:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103280384:0@lo:400:kworker.0 00000100:00100000:0.0:1788390560.206114:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390560.206118:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103280512:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.206150:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.206155:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103280896:0@lo:400:kworker.0 00000100:00100000:0.0:1788390560.206183:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.206232:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280896 00000100:00100000:0.0:1788390560.206237:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280896 00000100:00100000:3.0:1788390560.206239:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390560.206284:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.206291:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390560.206303:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103280896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.206319:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281024 00000100:00100000:3.0:1788390560.206323:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281024 00000100:00100000:0.0:1788390560.206351:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103280896:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390560.206352:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390560.206361:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103281024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390560.206365:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788390560.206387:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788390560.206388:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788390560.206391:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390560.206415:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103280896:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.206432:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103281024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390560.206439:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390560.206472:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390560.207056:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280512 00000100:00100000:2.0:1788390560.207062:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280512 00000100:00100000:1.0:1788390560.207115:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103280384 00000100:00100000:1.0:1788390560.207121:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103280384 00000100:00100000:2.0:1788390560.207130:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390560.207137:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103280512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390560.207178:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103280512:12345-0@lo:400:kworker.0 Request processed in 41us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390560.207184:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390560.207197:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390560.207203:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390560.207240:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103280384:12345-0@lo:400:kworker.0 Request processed in 31us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390560.207245:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788390560.207385:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390560.207421:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103280384:0@lo:400:kworker.0 00000100:00100000:3.0:1788390560.207447:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103280512:0@lo:400:kworker.0 00010000:00010000:2.0:1788390560.845277:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390561.512852:0:18019:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390561.512862:0:18019:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390561.512907:0:18019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390561.512914:0:18019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390561.869215:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390562.637902:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390562.637912:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390562.637953:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390562.638222:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390562.765174:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390562.765258:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390562.765325:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281152 00000100:00100000:1.0:1788390562.765335:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281152 00000100:00100000:1.0:1788390562.765407:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390562.765417:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390562.765451:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788390562.768272:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390562.773704:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8277us (8435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390562.773710:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390562.773722:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788390562.896002:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390562.935776:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390562.935816:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390562.935828:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881216 00000100:00100000:0.0:1788390562.935839:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881216 00000100:00100000:3.0:1788390562.935857:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390562.935902:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1788390562.935908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390562.935920:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093881216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390562.935935:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881344 00000100:00100000:3.0:1788390562.935941:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881344 00000100:00100000:3.0:1788390562.936004:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881600 00000100:00100000:3.0:1788390562.936007:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881600 00000100:00100000:3.0:1788390562.936102:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788390562.936112:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093881344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390562.936212:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881472 00000100:00100000:2.0:1788390562.936218:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881472 00000100:00100000:3.0:1788390562.936252:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093881344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390562.936259:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788390562.936274:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1788390562.936283:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788390562.936286:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093881472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390562.936295:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093881600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390562.936325:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093881472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390562.936332:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093881600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390562.936347:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788390562.936457:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093881216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 543us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390562.936463:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00080000:0.0:1788390562.936492:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390562.936496:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390562.936722:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000040:00080000:3.0:1788390563.152848:0:18070:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390563.152856:0:18070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390563.153304:0:18070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390563.153314:0:18070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390563.917154:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390564.803944:0:18122:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390564.803953:0:18122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390564.804016:0:18122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390564.804021:0:18122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390564.941160:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390565.325447:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390565.326423:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103281408:0@lo:400:kworker.0 00000100:00100000:2.0:1788390565.326495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390565.326554:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390565.326560:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103281536:0@lo:400:kworker.0 00000100:00100000:2.0:1788390565.326588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390565.326623:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281408 00000100:00100000:2.0:1788390565.326629:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281408 00000100:00100000:3.0:1788390565.327278:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788390565.327291:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390565.327349:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103281408:12345-0@lo:400:kworker.0 Request processed in 62us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390565.327366:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788390565.327417:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103281408:0@lo:400:kworker.0 00000100:00100000:3.0:1788390565.327455:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281536 00000100:00100000:3.0:1788390565.327472:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281536 00000100:00100000:3.0:1788390565.327523:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390565.327530:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103281536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390565.327568:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103281536:12345-0@lo:400:kworker.0 Request processed in 38us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390565.327574:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390565.327602:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103281536:0@lo:400:kworker.0 00000100:00080000:2.0:1788390565.328419:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390565.328695:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281664:0@lo:400:kworker.0 00000100:00100000:1.0:1788390565.328741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390565.328813:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390565.328836:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390565.329426:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281280 00000100:00100000:3.0:1788390565.329434:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281280 00000100:00100000:3.0:1788390565.329493:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390565.329503:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390565.329538:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390565.329583:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390565.329590:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788390565.329653:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390565.329690:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390565.329878:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281664 00000100:00100000:2.0:1788390565.329882:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281664 00000100:00100000:2.0:1788390565.330069:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390565.330078:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390565.330129:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103281664:12345-0@lo:400:kworker.0 Request processed in 53us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390565.330136:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390565.330193:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103281664:0@lo:400:kworker.0 00000100:00100000:1.0:1788390565.330297:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103281792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390565.330318:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103282048:0@lo:400:kworker.0 00000100:00100000:1.0:1788390565.330353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390565.330421:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103281920:0@lo:400:kworker.0 00000100:00100000:3.0:1788390565.332438:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390565.332438:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281792 00000100:00100000:0.0:1788390565.332449:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281792 00000100:00100000:0.0:1788390565.332500:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103281920 00000100:00100000:0.0:1788390565.332504:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103281920 00000100:00100000:3.0:1788390565.332508:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390565.332521:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103281792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390565.332541:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390565.332563:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103281920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390565.332591:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103281792:12345-0@lo:400:kworker.0 Request processed in 73us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390565.332599:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390565.332605:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103281920:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390565.332611:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390565.332648:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390565.332650:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390565.332678:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282048 00000100:00100000:0.0:1788390565.332681:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282048 00000100:00100000:3.0:1788390565.332687:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103281920:0@lo:400:kworker.0 00000100:00100000:0.0:1788390565.332702:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390565.332708:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103282048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788390565.332722:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390565.332734:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103282048:12345-0@lo:400:kworker.0 Request processed in 27us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390565.332739:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390565.332758:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103282048:0@lo:400:kworker.0 00000100:00100000:1.0:1788390565.332795:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103281792:0@lo:400:kworker.0 00010000:00010000:1.0:1788390565.966293:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390566.401454:0:18173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390566.401463:0:18173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390566.401507:0:18173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390566.401512:0:18173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390566.989518:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390567.886129:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390567.888956:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103282176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390567.889086:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390567.889240:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282176 00000100:00100000:3.0:1788390567.889270:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282176 00000100:00100000:3.0:1788390567.889361:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390567.889374:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103282176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390567.889416:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390567.889490:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103282176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390567.889499:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390567.889531:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103282176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390567.891014:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390568.013232:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390568.022681:0:18225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390568.022692:0:18225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390568.022738:0:18225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390568.022743:0:18225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390568.065568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390568.065606:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390568.065630:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881728 00000100:00100000:1.0:1788390568.065637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390568.065638:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881728 00000100:00100000:1.0:1788390568.065664:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390568.065682:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788390568.065692:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093881728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390568.065757:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093881728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390568.065764:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788390568.065793:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881856 00000100:00100000:0.0:1788390568.065803:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881856 00000100:00100000:0.0:1788390568.065835:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882112 00000100:00100000:0.0:1788390568.065838:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882112 00000100:00100000:3.0:1788390568.065849:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390568.065856:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093881856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390568.065861:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1788390568.065866:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093882112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390568.065916:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093881984 00000100:00100000:2.0:1788390568.065920:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093881984 00000100:00100000:2.0:1788390568.065951:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1788390568.065958:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093881984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390568.066035:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093881856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390568.066045:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1788390568.066299:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093882112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 430us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390568.066305:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00080000:0.0:1788390568.066326:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390568.066331:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390568.066994:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093881984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1035us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390568.067003:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00010000:00010000:1.0:1788390569.037559:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390569.500133:0:18276:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390569.500141:0:18276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390569.500210:0:18276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390569.500215:0:18276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390570.061259:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390570.445182:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390570.445205:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103282304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390570.445274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390570.445345:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103282560:0@lo:400:kworker.0 00000100:00100000:3.0:1788390570.445350:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103282688:0@lo:400:kworker.0 00000100:00100000:2.0:1788390570.445381:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390570.445393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390570.445404:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788390570.445411:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103282432:0@lo:400:kworker.0 00000100:00100000:3.0:1788390570.445417:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390570.445427:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103282816:0@lo:400:kworker.0 00000100:00100000:2.0:1788390570.445445:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390570.445460:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390570.445470:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103282944:0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.445490:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282560 00000100:00100000:2.0:1788390570.445495:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390570.445501:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282560 00000100:00100000:0.0:1788390570.445540:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282304 00000100:00100000:0.0:1788390570.445545:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282304 00000100:00100000:3.0:1788390570.445568:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282688 00000100:00100000:1.0:1788390570.445572:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788390570.445575:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282688 00000100:00100000:0.0:1788390570.445579:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390570.445588:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103282560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390570.445589:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103282304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390570.445613:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282816 00000100:00100000:3.0:1788390570.445617:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282816 00002000:00000024:0.0:1788390570.445622:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390570.445639:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282944 00000100:00100000:3.0:1788390570.445643:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282944 00000100:00100000:3.0:1788390570.445660:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788390570.445667:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103282688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.446109:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103282560:12345-0@lo:400:kworker.0 Request processed in 527us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.446117:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788390570.446141:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390570.446145:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390570.446154:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390570.446194:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390570.446202:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103282816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.446238:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103282816:12345-0@lo:400:kworker.0 Request processed in 38us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.446244:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390570.446261:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788390570.446267:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103282944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.446293:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103282944:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.446298:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788390570.446335:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103282816:0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.446467:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103282432 00000100:00100000:1.0:1788390570.446472:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103282432 00000100:00100000:1.0:1788390570.446499:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788390570.446504:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103282432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.446532:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103282432:12345-0@lo:400:kworker.0 Request processed in 28us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.446538:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788390570.447669:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103282944:0@lo:400:kworker.0 00000100:00100000:2.0:1788390570.447685:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103282560:0@lo:400:kworker.0 00000100:00100000:2.0:1788390570.447711:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103282432:0@lo:400:kworker.0 00000100:00100000:0.0:1788390570.447820:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103282304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2232us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.447832:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390570.447833:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103282688:12345-0@lo:400:kworker.0 Request processed in 2163us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390570.447844:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390570.447946:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103282688:0@lo:400:kworker.0 00000100:00100000:1.0:1788390570.447980:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103282304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788390571.087201:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390571.281421:0:18327:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390571.281437:0:18327:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390571.281493:0:18327:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788390571.281500:0:18327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390572.110183:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390572.877630:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390572.877643:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390572.877678:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390572.877687:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1788390572.970878:0:18378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390572.970893:0:18378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390572.970947:0:18378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390572.971029:0:18378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390573.005620:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390573.005653:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390573.005749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390573.005823:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283072 00000100:00100000:2.0:1788390573.005833:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283072 00000100:00100000:2.0:1788390573.005903:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390573.005913:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390573.005983:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390573.006037:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.006045:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788390573.006070:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390573.006111:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390573.135117:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390573.175620:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390573.175674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390573.175731:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390573.175837:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882240 00000100:00100000:0.0:1788390573.175858:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882240 00000100:00100000:0.0:1788390573.175933:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1788390573.175944:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093882240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390573.176078:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093882240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 135us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.176087:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:1.0:1788390573.176345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390573.176407:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882496 00000100:00100000:2.0:1788390573.176420:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882496 00000100:00100000:2.0:1788390573.176488:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788390573.176496:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093882496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390573.176540:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093882496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.176548:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00080000:0.0:1788390573.177221:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390573.180911:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882368 00000100:00100000:3.0:1788390573.180938:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882368 00000100:00100000:0.0:1788390573.181320:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882624 00000100:00100000:0.0:1788390573.181326:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882624 00000100:00100000:0.0:1788390573.181551:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788390573.181567:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093882624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390573.181686:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093882624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 122us (5338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.181694:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00080000:2.0:1788390573.181746:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390573.182074:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390573.182182:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390573.182194:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093882368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390573.182247:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093882368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.182253:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00010000:00010000:1.0:1788390574.159705:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390574.589007:0:18430:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390574.589017:0:18430:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390574.589048:0:18430:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390574.589053:0:18430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390575.181204:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390575.565410:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103283200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390575.565487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.565814:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283200 00000100:00100000:3.0:1788390575.565822:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283200 00000100:00100000:3.0:1788390575.565871:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390575.565878:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103283200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390575.565911:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390575.565955:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103283200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.565978:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390575.566013:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103283200:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788390575.568212:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390575.571464:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103283328:0@lo:400:kworker.0 00000100:00100000:2.0:1788390575.571576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.571728:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103283712:0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.571765:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.571808:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283712 00000100:00100000:3.0:1788390575.571815:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283712 00000100:00100000:3.0:1788390575.571871:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390575.571881:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103283712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.571941:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103283712:12345-0@lo:400:kworker.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.571948:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390575.572011:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103283712:0@lo:400:kworker.0 00000100:00100000:1.0:1788390575.572129:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283328 00000100:00100000:1.0:1788390575.572134:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283328 00000100:00100000:1.0:1788390575.572175:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788390575.572182:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103283328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572270:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283456:0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572298:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.572319:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390575.572326:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103283584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572348:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390575.572377:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390575.572407:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283584 00000100:00100000:3.0:1788390575.572411:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283584 00000100:00100000:3.0:1788390575.572436:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788390575.572442:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572477:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103283584:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.572483:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788390575.572513:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103283584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572540:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283456 00000100:00100000:3.0:1788390575.572557:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283456 00000100:00100000:3.0:1788390575.572589:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390575.572595:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.572630:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283456:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.572636:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788390575.572650:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390575.572666:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283456:0@lo:400:kworker.0 00000100:00100000:0.0:1788390575.585481:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390575.585504:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103283840:0@lo:400:kworker.0 00000100:00100000:0.0:1788390575.585625:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.585671:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283840 00000100:00100000:3.0:1788390575.585682:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283840 00000100:00080000:0.0:1788390575.585746:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390575.585754:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788390575.585766:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103283840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390575.585829:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103283840:12345-0@lo:400:kworker.0 Request processed in 65us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.585837:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788390575.585869:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103283840:0@lo:400:kworker.0 00000100:00100000:1.0:1788390575.586040:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103283328:12345-0@lo:400:kworker.0 Request processed in 13856us (14462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390575.586050:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788390575.586358:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103283328:0@lo:400:kworker.0 00000040:00080000:2.0:1788390576.166233:0:18481:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390576.166244:0:18481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390576.166285:0:18481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390576.166355:0:18481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390576.207769:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390577.229147:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390577.768501:0:18532:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390577.768511:0:18532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390577.768557:0:18532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788390577.768644:0:18532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390578.127644:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390578.127713:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390578.127840:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103283968 00000100:00100000:2.0:1788390578.127848:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103283968 00000100:00100000:2.0:1788390578.127905:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390578.127912:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390578.127940:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390578.128015:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103283968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390578.128041:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788390578.128154:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390578.128189:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103283968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390578.253459:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390578.293846:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390578.293949:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390578.294009:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390578.294052:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390578.294142:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882880 00000100:00100000:2.0:1788390578.294160:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882880 00000100:00100000:2.0:1788390578.294281:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883136 00000100:00100000:2.0:1788390578.294285:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883136 00000100:00100000:2.0:1788390578.294314:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1788390578.294324:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093882880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390578.294414:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093882880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390578.294422:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1788390578.294439:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390578.294446:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093883136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390578.294470:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093883136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390578.294476:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788390578.294494:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883008 00000100:00100000:2.0:1788390578.294497:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883008 00000100:00100000:2.0:1788390578.294537:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390578.294543:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093883008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390578.294567:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093883008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390578.294572:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00080000:1.0:1788390578.294768:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390578.294773:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390578.295722:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093882752 00000100:00100000:0.0:1788390578.295729:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093882752 00000100:00100000:0.0:1788390578.295832:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1788390578.295840:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093882752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390578.295943:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093882752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390578.295977:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00010000:00010000:0.0:1788390579.278585:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390579.534067:0:18583:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390579.534086:0:18583:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390579.534151:0:18583:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788390579.534158:0:18583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390580.301294:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390580.685764:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103284480:0@lo:400:kworker.0 00000100:00100000:3.0:1788390580.685844:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390580.685902:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788390580.685910:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788390580.685940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390580.685983:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284352:0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.686018:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390580.686049:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390580.686078:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284096 00000100:00100000:1.0:1788390580.686086:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284096 00000100:00100000:0.0:1788390580.686087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390580.686111:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788390580.686119:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284224:0@lo:400:kworker.0 00000100:00100000:1.0:1788390580.686142:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788390580.686153:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103284096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.686161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390580.686183:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103284736:0@lo:400:kworker.0 00000100:00100000:1.0:1788390580.686208:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103284096:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390580.686217:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390580.686228:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390580.686254:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284864 00000100:00100000:0.0:1788390580.686259:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284864 00000100:00100000:1.0:1788390580.686275:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284480 00000100:00100000:1.0:1788390580.686281:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284480 00000100:00100000:1.0:1788390580.686314:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284736 00000100:00100000:1.0:1788390580.686317:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284736 00000100:00100000:0.0:1788390580.686322:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390580.686332:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390580.686344:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390580.686352:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103284480:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788390580.686364:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390580.686388:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103284480:12345-0@lo:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390580.686396:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390580.686410:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390580.686415:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390580.686420:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103284736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.686427:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390580.686472:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390580.686473:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103284736:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390580.686485:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390580.686503:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103284736:0@lo:400:kworker.0 00000100:00080000:0.0:1788390580.686532:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390580.686538:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390580.686568:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284352 00000100:00100000:0.0:1788390580.686580:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284352 00000100:00100000:0.0:1788390580.686604:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284224 00000100:00100000:0.0:1788390580.686607:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284224 00000100:00100000:0.0:1788390580.686632:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788390580.686638:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390580.686672:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390580.686677:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284352:12345-0@lo:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390580.686684:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.686690:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788390580.686713:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390580.686724:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103284224:12345-0@lo:400:kworker.0 Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390580.686731:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390580.686736:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284224:0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.686749:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103284352:0@lo:400:kworker.0 00000100:00100000:3.0:1788390580.686870:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103284608:0@lo:400:kworker.0 00000100:00100000:3.0:1788390580.686896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390580.686927:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103284480:0@lo:400:kworker.0 00000100:00100000:3.0:1788390580.686939:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103284096:0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.687352:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284608 00000100:00100000:0.0:1788390580.687357:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284608 00000100:00100000:0.0:1788390580.687399:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788390580.687407:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103284608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390580.687444:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103284608:12345-0@lo:400:kworker.0 Request processed in 38us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390580.687450:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788390580.687873:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390580.688081:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103284608:0@lo:400:kworker.0 00000040:00080000:2.0:1788390581.227142:0:18635:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390581.227152:0:18635:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390581.227200:0:18635:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788390581.227213:0:18635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390581.326110:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390582.094179:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390582.094188:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390582.094490:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 1 00000040:00080000:3.0:1788390582.094495:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390582.349664:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390582.999772:0:18686:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390582.999780:0:18686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390583.001794:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390583.001810:0:18686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390583.245400:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103284992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390583.245470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390583.245602:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103284992 00000100:00100000:0.0:1788390583.245609:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103284992 00000100:00100000:0.0:1788390583.245663:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390583.245669:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103284992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390583.245697:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390583.245766:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103284992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390583.245771:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390583.245821:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103284992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390583.245917:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390583.373232:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390583.417200:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390583.417243:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390583.417278:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390583.417306:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883264 00000100:00100000:1.0:1788390583.417313:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390583.417316:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883264 00000100:00100000:1.0:1788390583.417353:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883392 00000100:00100000:1.0:1788390583.417357:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883392 00000100:00100000:0.0:1788390583.417364:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788390583.417374:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093883264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390583.417390:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883648 00000100:00100000:1.0:1788390583.417392:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883648 00000100:00100000:1.0:1788390583.417424:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1788390583.417429:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093883392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390583.417441:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093883264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390583.417448:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1788390583.417458:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093883392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390583.417464:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1788390583.417474:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390583.417480:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093883648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390583.417501:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093883648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390583.417507:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00080000:0.0:1788390583.417603:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390583.417675:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883520 00000100:00100000:3.0:1788390583.417680:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883520 00000100:00100000:3.0:1788390583.417771:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788390583.417779:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093883520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390583.417813:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093883520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390583.417820:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00080000:0.0:1788390583.418103:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390584.400259:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390584.834783:0:18737:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390584.834792:0:18737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390584.835776:0:18737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390584.835788:0:18737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390585.421241:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390585.805803:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390585.805907:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390585.806087:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285120 00000100:00100000:0.0:1788390585.806095:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285120 00000100:00080000:2.0:1788390585.806177:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390585.806186:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390585.806199:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103285120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390585.806239:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390585.806294:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103285120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390585.806303:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390585.806350:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390585.810476:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103285376:0@lo:400:kworker.0 00000100:00100000:3.0:1788390585.810508:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103285504:0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.810557:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390585.810558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390585.810648:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285376 00000100:00100000:0.0:1788390585.810656:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285376 00000100:00100000:0.0:1788390585.810717:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390585.810735:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103285376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390585.810785:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103285376:12345-0@lo:400:kworker.0 Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390585.810792:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390585.810882:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103285376:0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.810902:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788390585.810908:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103285248:0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.810934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390585.810985:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103285760:0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.811031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390585.811060:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285504 00000100:00100000:1.0:1788390585.811068:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285504 00000100:00100000:1.0:1788390585.811094:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285760 00000100:00100000:1.0:1788390585.811097:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285760 00000100:00100000:1.0:1788390585.811113:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390585.811118:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.811144:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103285504:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390585.811149:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390585.811158:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390585.811164:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390585.811190:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103285760:12345-0@lo:400:kworker.0 Request processed in 26us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390585.811196:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390585.811226:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788390585.811301:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285248 00000100:00100000:0.0:1788390585.811305:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285248 00000100:00100000:0.0:1788390585.811339:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390585.811345:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103285248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390585.811380:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103285248:12345-0@lo:400:kworker.0 Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390585.811386:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390585.811418:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103285248:0@lo:400:kworker.0 00000100:00080000:2.0:1788390585.812294:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390585.812301:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390585.812314:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103285632:0@lo:400:kworker.0 00000100:00100000:2.0:1788390585.812350:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390585.812442:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285632 00000100:00100000:0.0:1788390585.812448:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285632 00000100:00100000:0.0:1788390585.812502:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788390585.812510:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103285632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390585.812559:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103285632:12345-0@lo:400:kworker.0 Request processed in 50us (207us total) trans 0 rc 0/0 00000100:00080000:2.0:1788390585.812561:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390585.812568:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788390585.812590:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103285632:0@lo:400:kworker.0 00000100:00100000:3.0:1788390585.818356:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103285504:0@lo:400:kworker.0 00010000:00010000:0.0:1788390586.446127:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390586.537136:0:18788:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390586.537149:0:18788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390586.537813:0:18788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390586.537825:0:18788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390587.470430:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390588.319147:0:18839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390588.319157:0:18839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390588.319675:0:18839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390588.319683:0:18839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390588.369712:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390588.369735:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103285888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390588.369844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390588.369909:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103285888 00000100:00100000:3.0:1788390588.369917:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103285888 00000100:00100000:3.0:1788390588.370007:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390588.370019:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103285888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390588.370053:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390588.370099:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103285888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390588.370106:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788390588.370128:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390588.370165:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103285888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390588.493072:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390588.534914:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390588.535062:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390588.535088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390588.535125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390588.535164:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883904 00000100:00100000:1.0:1788390588.535175:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883904 00000100:00100000:1.0:1788390588.535232:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884160 00000100:00100000:1.0:1788390588.535235:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884160 00000100:00100000:1.0:1788390588.535262:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390588.535273:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093883904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390588.535371:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093883904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390588.535378:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390588.535395:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788390588.535402:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093884160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390588.535428:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093884160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390588.535433:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788390588.535605:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884032 00000100:00100000:2.0:1788390588.535609:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884032 00000100:00100000:2.0:1788390588.535651:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788390588.535659:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093884032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390588.535693:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093884032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390588.535700:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00080000:3.0:1788390588.535818:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390588.535823:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390588.536294:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093883776 00000100:00100000:0.0:1788390588.536300:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093883776 00000100:00100000:0.0:1788390588.536465:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1788390588.536474:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093883776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390588.536528:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093883776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390588.536536:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00010000:00010000:1.0:1788390589.519069:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390589.922728:0:18891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390589.922735:0:18891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390589.927340:0:18891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390589.927356:0:18891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390590.541326:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390590.926003:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103286272:0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.926070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390590.926125:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390590.926130:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103286400:0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.926151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390590.926180:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286272 00000100:00100000:1.0:1788390590.926187:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286272 00000100:00100000:1.0:1788390590.926268:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390590.926277:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103286272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.926319:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103286272:12345-0@lo:400:kworker.0 Request processed in 43us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390590.926326:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390590.926353:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286400 00000100:00100000:1.0:1788390590.926356:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286400 00000100:00100000:1.0:1788390590.926376:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390590.926381:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.926405:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103286400:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390590.926411:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390590.926443:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103286400:0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.926452:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103286272:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.926737:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.926783:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390590.926808:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103286528:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.926828:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390590.926844:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788390590.926849:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103286144:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.926865:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390590.926876:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103286656:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.926890:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390590.926909:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390590.926926:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286528 00000100:00100000:3.0:1788390590.926929:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286528 00000100:00100000:3.0:1788390590.927002:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286656 00000100:00100000:3.0:1788390590.927006:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286656 00000100:00100000:3.0:1788390590.927025:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788390590.927031:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103286528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.927064:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103286528:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390590.927070:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788390590.927083:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788390590.927089:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103286656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.927113:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103286656:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390590.927119:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788390590.927138:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390590.927156:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103286656:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.927166:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103286528:0@lo:400:kworker.0 00000100:00100000:2.0:1788390590.927252:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286144 00000100:00100000:2.0:1788390590.927256:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286144 00000100:00100000:2.0:1788390590.927293:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788390590.927300:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103286144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390590.927334:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103286144:12345-0@lo:400:kworker.0 Request processed in 36us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390590.927340:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788390590.927415:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390590.927432:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103286144:0@lo:400:kworker.0 00000100:00100000:2.0:1788390590.927477:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103286784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390590.927504:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390590.927628:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286016 00000100:00100000:1.0:1788390590.927633:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286016 00000100:00100000:1.0:1788390590.927668:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788390590.927675:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390590.927721:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103286016:12345-0@lo:400:kworker.0 Request processed in 46us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390590.927727:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788390590.927747:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286784 00000100:00100000:3.0:1788390590.927751:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286784 00000100:00100000:3.0:1788390590.927774:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390590.927781:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103286784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390590.927811:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390590.927834:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788390590.927859:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103286784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390590.927883:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390590.928225:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103286784:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788390591.535431:0:18944:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390591.535442:0:18944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390591.536094:0:18944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390591.536104:0:18944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390591.565770:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390592.333384:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390592.333404:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390592.333932:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390592.333942:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390592.589479:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390593.257596:0:18995:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390593.257605:0:18995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390593.264251:0:18995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390593.264267:0:18995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390593.488064:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103286912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390593.488154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390593.488718:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103286912 00000100:00100000:3.0:1788390593.488729:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103286912 00000100:00100000:3.0:1788390593.488809:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390593.488819:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103286912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390593.488855:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390593.488916:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103286912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390593.488933:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390593.489794:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103286912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390593.490563:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390593.613654:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390593.657998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390593.658064:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390593.658101:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390593.658176:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884544 00000100:00100000:0.0:1788390593.658176:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884288 00000100:00100000:3.0:1788390593.658186:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884544 00000100:00100000:0.0:1788390593.658186:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884288 00000100:00100000:3.0:1788390593.658250:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1788390593.658260:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093884544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390593.658340:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093884544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390593.658348:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788390593.658717:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1788390593.658728:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093884288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390593.658757:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093884288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390593.658764:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00080000:0.0:1788390593.658872:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390593.660761:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884416 00000100:00100000:2.0:1788390593.660775:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884416 00000100:00100000:2.0:1788390593.660873:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788390593.660883:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093884416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390593.661000:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093884416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 118us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390593.661007:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00080000:0.0:1788390593.662255:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390593.664597:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390593.664696:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884672 00000100:00100000:0.0:1788390593.664707:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884672 00000100:00100000:0.0:1788390593.664783:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788390593.664794:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093884672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390593.664876:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093884672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390593.664883:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00080000:1.0:1788390593.664956:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788390594.639251:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390594.926464:0:19046:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390594.926473:0:19046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390594.927286:0:19046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390594.927298:0:19046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390595.661259:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390596.045296:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390596.045381:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390596.045457:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287040 00000100:00100000:0.0:1788390596.045465:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287040 00000100:00100000:0.0:1788390596.045521:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390596.045531:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103287040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390596.045586:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390596.045632:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103287040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390596.045644:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788390596.045665:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390596.045706:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390596.045868:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103287296:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.045882:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103287552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390596.045918:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390596.045937:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390596.045976:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788390596.045980:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390596.045982:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103287168:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390596.046025:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103287680:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046039:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390596.046067:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287552 00000100:00100000:2.0:1788390596.046070:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287552 00000100:00100000:2.0:1788390596.046093:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287680 00000100:00100000:2.0:1788390596.046095:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287680 00000100:00100000:3.0:1788390596.046107:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103287424:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046109:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390596.046117:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390596.046146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390596.046162:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103287552:12345-0@lo:400:kworker.0 Request processed in 45us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390596.046168:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390596.046181:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287424 00000100:00100000:2.0:1788390596.046183:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287424 00000100:00100000:3.0:1788390596.046191:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287296 00000100:00100000:2.0:1788390596.046200:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390596.046204:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287296 00000100:00100000:2.0:1788390596.046205:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103287680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046232:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103287680:12345-0@lo:400:kworker.0 Request processed in 28us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390596.046236:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788390596.046247:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390596.046252:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390596.046257:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788390596.046269:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103287296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046276:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103287424:12345-0@lo:400:kworker.0 Request processed in 23us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390596.046280:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390596.046299:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103287680:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046310:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103287552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390596.046319:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103287296:12345-0@lo:400:kworker.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390596.046349:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103287424:0@lo:400:kworker.0 00000100:00100000:2.0:1788390596.046365:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103287296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390596.046652:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390596.046723:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287168 00000100:00100000:0.0:1788390596.046728:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287168 00000100:00100000:0.0:1788390596.046756:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788390596.046764:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103287168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390596.046850:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103287168:12345-0@lo:400:kworker.0 Request processed in 86us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390596.046857:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788390596.046886:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390596.046900:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390596.047094:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103287168:0@lo:400:kworker.0 00000040:00080000:0.0:1788390596.510754:0:19098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390596.513073:0:19098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390596.513649:0:19098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390596.513660:0:19098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390596.686079:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390597.712847:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390598.141697:0:19149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390598.141706:0:19149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390598.142488:0:19149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390598.142498:0:19149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390598.605320:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103287808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390598.605398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390598.605530:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287808 00000100:00100000:3.0:1788390598.605538:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287808 00000100:00100000:3.0:1788390598.605611:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390598.605621:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103287808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390598.605656:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390598.605705:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103287808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390598.605713:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390598.605759:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103287808:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390598.606990:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390598.737470:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390598.774527:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390598.774621:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390598.774718:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390598.774752:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390598.774778:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885056 00000100:00100000:1.0:1788390598.774787:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885056 00000100:00100000:1.0:1788390598.774860:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788390598.774869:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093885056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390598.774947:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093885056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390598.774996:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00080000:1.0:1788390598.775018:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390598.775547:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884800 00000100:00100000:0.0:1788390598.775553:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884800 00000100:00100000:0.0:1788390598.775597:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:0.0:1788390598.775605:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093884800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390598.775645:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093884800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390598.775651:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:2.0:1788390598.776179:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093884928 00000100:00100000:2.0:1788390598.776185:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093884928 00000100:00100000:2.0:1788390598.776296:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885184 00000100:00100000:2.0:1788390598.776300:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885184 00000100:00100000:3.0:1788390598.776454:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788390598.776464:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093884928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390598.776508:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093884928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 47us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390598.776514:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00080000:1.0:1788390598.777029:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390598.777236:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:2.0:1788390598.777245:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093885184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390598.777295:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093885184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390598.777301:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00010000:00010000:1.0:1788390599.758726:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390599.907095:0:19200:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390599.907106:0:19200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390599.907640:0:19200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390599.907652:0:19200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390600.784996:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390601.166507:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103287936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390601.166509:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103288192:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170167:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390601.170230:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103288448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390601.170302:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390601.170309:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103288320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170333:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390601.170365:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103288064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170393:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390601.170413:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103288576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170428:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390601.170454:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103287936 00000100:00100000:3.0:1788390601.170460:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103287936 00000100:00100000:3.0:1788390601.170523:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390601.170532:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103287936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390601.170567:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390601.170605:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103287936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390601.170612:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390601.170635:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288448 00000100:00100000:3.0:1788390601.170638:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288448 00000100:00100000:3.0:1788390601.170657:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288576 00000100:00100000:3.0:1788390601.170659:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288576 00000100:00100000:3.0:1788390601.170676:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788390601.170681:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170706:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103288448:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390601.170723:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788390601.170733:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788390601.170737:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103288576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170761:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103288576:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390601.170766:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788390601.170779:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288320 00000100:00100000:3.0:1788390601.170782:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288320 00000100:00100000:3.0:1788390601.170803:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788390601.170808:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103288320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.170835:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103288320:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390601.170841:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788390601.170858:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390601.170862:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390601.170901:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103288320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.171005:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103287936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390601.171014:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103288448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.171044:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103288576:0@lo:400:kworker.0 00000100:00100000:0.0:1788390601.171118:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288064 00000100:00100000:0.0:1788390601.171122:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288064 00000100:00100000:0.0:1788390601.171156:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390601.171163:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103288064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390601.171196:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103288064:12345-0@lo:400:kworker.0 Request processed in 34us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390601.171202:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390601.171232:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103288064:0@lo:400:kworker.0 00000100:00100000:1.0:1788390601.171691:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390601.171755:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103288704:0@lo:400:kworker.0 00000100:00100000:1.0:1788390601.171780:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390601.171852:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288704 00000100:00100000:0.0:1788390601.171857:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288704 00000100:00080000:1.0:1788390601.171981:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390601.172003:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390601.172012:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103288704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390601.172047:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103288704:12345-0@lo:400:kworker.0 Request processed in 37us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390601.172053:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390601.172078:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103288704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.172172:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288192 00000100:00100000:3.0:1788390601.172176:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288192 00000100:00100000:3.0:1788390601.172238:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390601.172245:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390601.172280:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103288192:12345-0@lo:400:kworker.0 Request processed in 35us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390601.172296:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390601.172324:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103288192:0@lo:400:kworker.0 00000100:00080000:1.0:1788390601.172381:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788390601.597767:0:19251:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390601.597778:0:19251:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390601.598496:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390601.598506:0:19251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390601.805258:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390602.573512:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390602.573521:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390602.574063:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390602.574071:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390602.829233:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390603.141099:0:19303:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390603.141108:0:19303:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390603.141692:0:19303:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390603.141706:0:19303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390603.725787:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390603.725814:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103288832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390603.725896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390603.726424:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288832 00000100:00100000:3.0:1788390603.726433:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288832 00000100:00100000:3.0:1788390603.726502:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390603.726511:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103288832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390603.726547:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390603.726613:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103288832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390603.726620:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390603.726666:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103288832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390603.726805:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390603.853405:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390603.893519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390603.893562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390603.893588:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390603.893661:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885440 00000100:00100000:0.0:1788390603.893671:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885440 00000100:00100000:0.0:1788390603.893732:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885696 00000100:00100000:0.0:1788390603.893736:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885696 00000100:00100000:1.0:1788390603.893741:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:1.0:1788390603.893765:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390603.893770:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788390603.893781:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093885440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390603.893798:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1788390603.893809:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093885696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390603.893884:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093885440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390603.893892:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1788390603.894012:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885312 00000100:00100000:2.0:1788390603.894017:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885312 00000100:00100000:2.0:1788390603.894045:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:2.0:1788390603.894052:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093885312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390603.894197:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885568 00000100:00100000:3.0:1788390603.894202:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885568 00000100:00100000:3.0:1788390603.894264:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788390603.894272:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093885568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390603.901195:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093885696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 7375us (7592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390603.901212:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00080000:1.0:1788390603.901388:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390603.902310:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093885312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 8253us (8741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390603.902321:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788390603.910075:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093885568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15790us (16321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390603.910092:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000040:00080000:0.0:1788390604.761340:0:19354:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390604.761350:0:19354:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390604.766060:0:19354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390604.766080:0:19354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390604.877536:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390605.902152:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390606.285242:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103289216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285295:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103289344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390606.285310:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390606.285332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390606.285367:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788390606.285367:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390606.285381:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285381:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103288960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390606.285404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390606.285420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390606.285426:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103289600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285449:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788390606.285450:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390606.285474:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390606.285497:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289216 00000100:00100000:3.0:1788390606.285506:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289216 00000100:00100000:0.0:1788390606.285507:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289344 00000100:00100000:0.0:1788390606.285511:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289344 00000100:00100000:0.0:1788390606.285547:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289600 00000100:00100000:3.0:1788390606.285549:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289088 00000100:00100000:0.0:1788390606.285550:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289600 00000100:00100000:3.0:1788390606.285555:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289088 00000100:00100000:0.0:1788390606.285572:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289472 00000100:00100000:0.0:1788390606.285576:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289472 00000100:00100000:0.0:1788390606.285588:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390606.285594:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103289344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285628:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103289344:12345-0@lo:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390606.285632:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390606.285643:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390606.285647:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285665:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103289600:12345-0@lo:400:kworker.0 Request processed in 18us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390606.285668:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390606.285674:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390606.285679:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103289472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285702:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103289472:12345-0@lo:400:kworker.0 Request processed in 23us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390606.285709:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788390606.285726:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390606.285733:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390606.285734:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788390606.285736:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390606.285744:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285773:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103289216:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390606.285779:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788390606.285783:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103288960 00000100:00100000:1.0:1788390606.285789:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103288960 00000100:00100000:0.0:1788390606.285797:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390606.285805:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390606.285818:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788390606.285825:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103288960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.285843:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390606.285886:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103288960:12345-0@lo:400:kworker.0 Request processed in 61us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390606.285888:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390606.285891:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788390606.285897:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788390606.285908:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390606.285945:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289728 00000100:00100000:2.0:1788390606.285949:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289728 00000100:00100000:1.0:1788390606.286817:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.286839:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103289344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390606.286848:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103289088:12345-0@lo:400:kworker.0 Request processed in 47us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390606.286851:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103289600:0@lo:400:kworker.0 00000100:00100000:3.0:1788390606.286858:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390606.286868:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103289216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390606.286876:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103288960:0@lo:400:kworker.0 00000100:00100000:2.0:1788390606.286989:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390606.287000:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103289728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390606.287025:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390606.287070:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103289728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390606.287109:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390606.287169:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:1.0:1788390606.374736:0:19405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390606.374747:0:19405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390606.375486:0:19405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390606.375495:0:19405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390606.925289:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390607.953148:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390608.038328:0:19456:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390608.038338:0:19456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390608.040005:0:19456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390608.040016:0:19456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390608.845509:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103289856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390608.845584:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390608.845705:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289856 00000100:00100000:2.0:1788390608.845732:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289856 00000100:00080000:0.0:1788390608.845788:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390608.845807:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390608.845830:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103289856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390608.845864:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390608.847248:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103289856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1415us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390608.847259:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390608.847586:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103289856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390608.973191:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390609.015036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390609.015087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390609.015114:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885824 00000100:00100000:1.0:1788390609.015128:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885824 00000100:00100000:0.0:1788390609.015133:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390609.015168:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390609.015194:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:1.0:1788390609.015207:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093885824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390609.015213:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093885952 00000100:00100000:0.0:1788390609.015218:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093885952 00000100:00100000:0.0:1788390609.015267:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886208 00000100:00100000:0.0:1788390609.015270:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886208 00000100:00100000:1.0:1788390609.015282:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093885824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390609.015291:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:0.0:1788390609.015297:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:0.0:1788390609.015306:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093885952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390609.015338:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:0.0:1788390609.015345:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093885952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390609.015350:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093886208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390609.015358:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00080000:0.0:1788390609.015380:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390609.015385:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093886208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390609.015392:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:3.0:1788390609.015458:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886080 00000100:00100000:3.0:1788390609.015463:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886080 00000100:00100000:3.0:1788390609.016085:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788390609.016096:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093886080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390609.016146:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093886080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390609.016153:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00080000:0.0:1788390609.016413:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788390609.755549:0:19507:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390609.755559:0:19507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390609.756059:0:19507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390609.756070:0:19507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390609.997158:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390611.021274:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390611.405877:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390611.409159:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103290112:0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.409242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390611.409293:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390611.409300:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103290240:0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.409328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390611.409371:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290112 00000100:00100000:1.0:1788390611.409378:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290112 00000100:00100000:1.0:1788390611.409435:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788390611.409445:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103290112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.409494:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103290112:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390611.409502:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788390611.409533:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290240 00000100:00100000:1.0:1788390611.409537:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290240 00000100:00100000:1.0:1788390611.409574:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390611.409581:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103290240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.409613:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103290240:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390611.409619:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788390611.409637:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390611.409667:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103290240:0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.409677:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103290112:0@lo:400:kworker.0 00000040:00080000:1.0:1788390611.411092:0:19560:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390611.411100:0:19560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390611.411630:0:19560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390611.411641:0:19560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390611.414651:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103290368:0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.414726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390611.414776:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103289984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390611.414813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390611.414839:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103289984 00000100:00100000:2.0:1788390611.414846:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103289984 00000100:00100000:2.0:1788390611.414901:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390611.414912:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103289984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390611.414977:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390611.415018:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103289984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390611.415026:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788390611.415170:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390611.415209:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103289984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390611.416180:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103290496:0@lo:400:kworker.0 00000100:00100000:0.0:1788390611.416225:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390611.416264:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290496 00000100:00100000:0.0:1788390611.416268:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290496 00000100:00100000:0.0:1788390611.416306:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390611.416313:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390611.416356:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103290496:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390611.416364:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390611.416398:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103290496:0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417289:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103290624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390611.417363:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390611.417369:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417391:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390611.417429:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290624 00000100:00100000:2.0:1788390611.417434:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290624 00000100:00100000:2.0:1788390611.417471:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290752 00000100:00100000:2.0:1788390611.417473:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290752 00000100:00100000:2.0:1788390611.417496:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788390611.417504:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103290624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417546:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103290624:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390611.417553:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788390611.417568:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788390611.417582:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103290752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417611:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103290752:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390611.417618:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788390611.417634:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390611.417661:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788390611.417670:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103290624:0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.418743:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290368 00000100:00100000:1.0:1788390611.418762:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290368 00000100:00100000:1.0:1788390611.418816:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390611.418825:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103290368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390611.418890:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103290368:12345-0@lo:400:kworker.0 Request processed in 65us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390611.418896:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390611.418953:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103290368:0@lo:400:kworker.0 00010000:00010000:2.0:1788390612.045357:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390612.813272:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390612.813281:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390612.813830:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390612.813840:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390613.069293:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390613.128625:0:19611:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390613.128636:0:19611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390613.136460:0:19611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390613.136484:0:19611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390613.965359:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390613.965383:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390613.965467:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390613.965613:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103290880 00000100:00100000:2.0:1788390613.965622:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103290880 00000100:00100000:2.0:1788390613.965706:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788390613.965717:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103290880:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390613.965752:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788390613.965756:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390613.965840:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103290880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390613.965848:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390613.966196:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103290880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390614.093235:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390614.140627:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390614.140677:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390614.140781:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886336 00000100:00100000:1.0:1788390614.140791:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886336 00000100:00100000:1.0:1788390614.140857:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:1.0:1788390614.140866:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093886336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390614.140938:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093886336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390614.140946:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:0.0:1788390614.141627:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390614.141673:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390614.141697:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886464 00000100:00100000:0.0:1788390614.141701:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886464 00000100:00100000:0.0:1788390614.141745:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886720 00000100:00100000:0.0:1788390614.141748:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886720 00000100:00100000:0.0:1788390614.141793:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:0.0:1788390614.141801:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093886464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390614.141856:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093886464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390614.141863:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:0.0:1788390614.141889:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788390614.141894:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093886720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390614.142076:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093886720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390614.142083:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00080000:0.0:1788390614.142183:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390614.145212:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886592 00000100:00100000:3.0:1788390614.145226:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886592 00000100:00100000:3.0:1788390614.145383:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788390614.145393:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093886592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390614.145480:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093886592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 88us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390614.145487:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00080000:0.0:1788390614.146446:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788390614.780303:0:19662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390614.780314:0:19662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390614.782160:0:19662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390614.782177:0:19662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390615.119557:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390616.141523:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390616.434607:0:19713:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390616.434618:0:19713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390616.435426:0:19713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390616.435441:0:19713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390616.525125:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103291008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390616.525202:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390616.525317:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291008 00000100:00100000:0.0:1788390616.525326:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291008 00000100:00100000:0.0:1788390616.525386:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390616.525397:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103291008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390616.525432:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788390616.529116:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390616.529331:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103291008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3932us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390616.529343:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390616.530911:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103291008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390616.538350:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103291264:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.538420:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390616.538470:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788390616.538477:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103291136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.538503:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390616.538524:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103291648:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.538547:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390616.538583:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291264 00000100:00100000:1.0:1788390616.538590:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291264 00000100:00100000:1.0:1788390616.538709:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788390616.538720:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103291264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.538781:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103291264:12345-0@lo:400:kworker.0 Request processed in 64us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390616.538788:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788390616.538950:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291136 00000100:00100000:1.0:1788390616.538954:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291136 00000100:00100000:1.0:1788390616.539007:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788390616.539015:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103291136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.539043:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103291136:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390616.539048:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788390616.539068:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390616.539084:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103291392:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.539108:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390616.539126:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390616.539131:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103291520:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.539151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390616.539185:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103291136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390616.539197:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103291264:0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.539759:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291648 00000100:00100000:0.0:1788390616.539763:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291648 00000100:00100000:0.0:1788390616.539798:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291392 00000100:00100000:0.0:1788390616.539801:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291392 00000100:00100000:0.0:1788390616.539817:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291520 00000100:00100000:0.0:1788390616.539821:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291520 00000100:00100000:0.0:1788390616.539836:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788390616.539843:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103291648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.539885:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103291648:12345-0@lo:400:kworker.0 Request processed in 42us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390616.539898:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788390616.539911:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390616.539917:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103291392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.539953:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103291392:12345-0@lo:400:kworker.0 Request processed in 36us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390616.539973:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390616.539985:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788390616.539991:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103291520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.540018:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103291520:12345-0@lo:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390616.540024:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788390616.540047:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390616.540071:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103291648:0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.540095:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103291520:0@lo:400:kworker.0 00000100:00100000:0.0:1788390616.540103:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103291392:0@lo:400:kworker.0 00010000:00010000:2.0:1788390617.165536:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390618.177429:0:19765:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390618.177442:0:19765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390618.180179:0:19765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390618.180195:0:19765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390618.200941:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390619.085187:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390619.085212:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103291776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390619.085280:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390619.085421:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291776 00000100:00100000:1.0:1788390619.085429:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291776 00000100:00100000:1.0:1788390619.085511:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390619.085522:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103291776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390619.085574:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390619.085626:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103291776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390619.085633:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390619.085678:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103291776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390619.085818:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390619.213230:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390619.261468:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390619.261515:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390619.261548:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390619.261588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390619.261623:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886976 00000100:00100000:0.0:1788390619.261648:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886976 00000100:00100000:0.0:1788390619.261706:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887232 00000100:00100000:0.0:1788390619.261709:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887232 00000100:00100000:0.0:1788390619.261747:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788390619.261757:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093886976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390619.261838:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093886976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390619.261846:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788390619.261865:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788390619.261872:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093887232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390619.262014:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093886848 00000100:00100000:2.0:1788390619.262024:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093886848 00000100:00100000:2.0:1788390619.262053:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1788390619.262060:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093886848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390619.262087:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093886848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390619.262094:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00080000:2.0:1788390619.262120:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390619.262444:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887104 00000100:00100000:3.0:1788390619.262449:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887104 00000100:00100000:3.0:1788390619.262506:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390619.262515:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093887104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390619.262551:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093887104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390619.262557:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00080000:2.0:1788390619.262692:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390619.262794:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093887232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 921us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390619.262802:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000040:00080000:3.0:1788390619.768149:0:19816:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390619.768159:0:19816:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390619.768694:0:19816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390619.768705:0:19816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390620.237223:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390621.261128:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390621.311561:0:19867:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390621.311571:0:19867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390621.313178:0:19867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390621.313192:0:19867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788390621.645192:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103292160:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.645261:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390621.645333:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390621.645340:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103292288:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.645365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390621.645448:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292160 00000100:00100000:2.0:1788390621.645457:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292160 00000100:00100000:2.0:1788390621.645520:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788390621.645529:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103292160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390621.645584:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103292160:12345-0@lo:400:kworker.0 Request processed in 56us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390621.645591:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788390621.645630:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103292160:0@lo:400:kworker.0 00000100:00080000:1.0:1788390621.645710:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390621.645876:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103291904:0@lo:400:kworker.0 00000100:00100000:0.0:1788390621.645910:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390621.645941:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103292416:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.645993:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103291904 00000100:00100000:1.0:1788390621.645998:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103291904 00000100:00100000:0.0:1788390621.645999:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390621.646015:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390621.646020:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103292032:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646028:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788390621.646034:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390621.646041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390621.646059:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103292544:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646063:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103291904:12345-0@lo:400:kworker.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390621.646069:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788390621.646077:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390621.646095:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103291904:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646112:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292288 00000100:00100000:0.0:1788390621.646113:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292032 00000100:00100000:1.0:1788390621.646116:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292288 00000100:00100000:0.0:1788390621.646116:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292032 00000100:00100000:0.0:1788390621.646158:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390621.646164:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103292032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390621.646198:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103292032:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390621.646205:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390621.646222:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292416 00000100:00080000:0.0:1788390621.646222:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390621.646226:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292416 00000100:00100000:1.0:1788390621.646247:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292544 00000100:00100000:1.0:1788390621.646250:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292544 00000100:00100000:0.0:1788390621.646256:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788390621.646262:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788390621.646262:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103292288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646267:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103292416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646290:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103292416:12345-0@lo:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390621.646293:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103292288:12345-0@lo:400:kworker.0 Request processed in 33us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390621.646299:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788390621.646302:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788390621.646311:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788390621.646316:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103292544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390621.646343:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103292544:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390621.646391:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103292288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390621.646422:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390621.646437:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103292672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390621.646465:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390621.646691:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103292032:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646715:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103292544:0@lo:400:kworker.0 00000100:00100000:1.0:1788390621.646723:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103292416:0@lo:400:kworker.0 00000100:00080000:1.0:1788390621.646754:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390621.646872:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390621.647034:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292672 00000100:00100000:2.0:1788390621.647040:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292672 00000100:00100000:2.0:1788390621.647758:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390621.647768:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103292672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390621.647802:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390621.647876:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103292672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390621.647883:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390621.649809:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103292672:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788390622.029206:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390622.029219:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390622.029788:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390622.029800:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390622.285121:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390622.863390:0:19918:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390622.863398:0:19918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390622.864839:0:19918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390622.864851:0:19918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390623.309449:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390624.210763:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390624.210784:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103292800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390624.210849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390624.210908:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292800 00000100:00100000:2.0:1788390624.210915:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292800 00000100:00100000:2.0:1788390624.211008:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788390624.211018:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103292800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390624.211053:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390624.211096:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103292800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390624.211115:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788390624.211159:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103292800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390624.211449:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390624.334130:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390624.374435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390624.374477:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390624.374504:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390624.374545:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390624.374585:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887488 00000100:00100000:0.0:1788390624.374595:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887488 00000100:00100000:0.0:1788390624.374650:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887744 00000100:00100000:0.0:1788390624.374653:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887744 00000100:00100000:0.0:1788390624.374688:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788390624.374708:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093887488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390624.374769:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1788390624.374778:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093887744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390624.374840:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093887744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 63us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390624.374848:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1788390624.374902:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093887488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 196us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390624.374908:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788390624.374927:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887360 00000100:00100000:0.0:1788390624.374930:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887360 00000100:00100000:0.0:1788390624.375019:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:0.0:1788390624.375027:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093887360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390624.375065:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093887360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390624.375077:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1788390624.378008:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887616 00000100:00100000:3.0:1788390624.378020:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887616 00000100:00100000:3.0:1788390624.378077:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390624.378087:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093887616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390624.378155:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093887616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390624.378163:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00080000:3.0:1788390624.378185:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390624.378189:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788390624.466956:0:19970:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390624.466983:0:19970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390624.467645:0:19970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390624.467653:0:19970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390625.357325:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390626.109230:0:20021:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390626.109240:0:20021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390626.110432:0:20021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390626.110449:0:20021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390626.383228:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390626.765095:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103292928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390626.765165:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390626.765619:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103292928 00000100:00100000:0.0:1788390626.765628:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103292928 00000100:00100000:0.0:1788390626.765715:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390626.765726:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103292928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390626.765758:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390626.765811:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103292928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390626.765818:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390626.765859:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103292928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788390626.767326:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390626.771274:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390626.771352:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390626.771453:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293056 00000100:00100000:1.0:1788390626.771461:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293056 00000100:00100000:0.0:1788390626.771502:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103293312:0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390626.771573:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390626.771579:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293184:0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771604:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390626.771659:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293312 00000100:00100000:0.0:1788390626.771663:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293312 00000100:00100000:0.0:1788390626.771707:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788390626.771731:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103293312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771784:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103293312:12345-0@lo:400:kworker.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390626.771791:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788390626.771813:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293184 00000100:00100000:0.0:1788390626.771817:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293184 00000100:00100000:0.0:1788390626.771848:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788390626.771856:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771897:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293184:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390626.771903:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788390626.771942:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293184:0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771952:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103293312:0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.771994:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103293440:0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.772018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390626.772045:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293440 00000100:00100000:0.0:1788390626.772049:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293440 00000100:00100000:0.0:1788390626.772074:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390626.772080:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103293440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390626.772112:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103293440:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390626.772118:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390626.772140:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103293440:0@lo:400:kworker.0 00000100:00080000:0.0:1788390626.772264:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390626.772268:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390626.772470:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788390626.772478:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103293056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390626.775643:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103293056:12345-0@lo:400:kworker.0 Request processed in 3157us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390626.775669:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788390626.779776:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390626.781171:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103293568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390626.781236:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390626.782640:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293568 00000100:00100000:1.0:1788390626.782664:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293568 00000100:00100000:1.0:1788390626.782751:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788390626.782761:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103293568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788390626.782875:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390626.791086:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103293568:12345-0@lo:400:kworker.0 Request processed in 8315us (9839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390626.791102:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788390626.792534:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103293568:0@lo:400:kworker.0 00010000:00010000:2.0:1788390627.405448:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390627.754297:0:20072:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390627.754306:0:20072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390627.755065:0:20072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390627.755076:0:20072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390628.434834:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390629.325162:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390629.325186:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390629.325261:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390629.325781:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293696 00000100:00100000:2.0:1788390629.325789:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293696 00000100:00100000:2.0:1788390629.325856:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390629.325866:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390629.325901:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390629.325951:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390629.325982:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390629.326040:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390629.326207:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788390629.418420:0:20123:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390629.418428:0:20123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390629.418845:0:20123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390629.418852:0:20123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390629.454513:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390629.493508:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390629.493543:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390629.493580:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390629.493606:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390629.493854:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888000 00000100:00100000:3.0:1788390629.493864:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888000 00000100:00100000:3.0:1788390629.493928:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888256 00000100:00100000:3.0:1788390629.493931:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888256 00000100:00100000:3.0:1788390629.493987:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:3.0:1788390629.493998:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093888000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788390629.494060:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390629.494077:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093888000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390629.494083:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:3.0:1788390629.494099:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1788390629.494105:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093888256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390629.494127:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093888256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390629.494133:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1788390629.494149:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888128 00000100:00100000:3.0:1788390629.494152:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888128 00000100:00100000:3.0:1788390629.494192:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390629.494199:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093888128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390629.494306:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093888128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 107us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390629.494313:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00080000:3.0:1788390629.494418:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390629.494771:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093887872 00000100:00100000:0.0:1788390629.494776:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093887872 00000100:00100000:0.0:1788390629.494820:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:0.0:1788390629.494828:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093887872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390629.494875:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093887872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390629.494882:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00010000:00010000:1.0:1788390630.477608:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390631.092082:0:20174:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390631.092089:0:20174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390631.092487:0:20174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390631.092495:0:20174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390631.501805:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390631.885128:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103294208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885181:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390631.885201:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390631.885216:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390631.885252:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103294080:0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885283:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103294336:0@lo:400:kworker.0 00000100:00100000:3.0:1788390631.885293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390631.885316:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103293952:0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885319:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390631.885348:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390631.885370:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293824 00000100:00100000:0.0:1788390631.885370:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103294464:0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885418:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293824 00000100:00100000:1.0:1788390631.885500:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390631.885510:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390631.885519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390631.885548:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294336 00002000:00000024:1.0:1788390631.885550:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390631.885552:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294336 00000100:00100000:0.0:1788390631.885589:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294464 00000100:00100000:0.0:1788390631.885592:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294464 00000100:00100000:0.0:1788390631.885626:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788390631.885633:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103293824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390631.885633:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103294336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885640:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390631.885666:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788390631.885674:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103294464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885706:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103294464:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390631.885712:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788390631.885730:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103293952 00000100:00100000:1.0:1788390631.885733:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103293952 00000100:00100000:0.0:1788390631.885759:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103294336:12345-0@lo:400:kworker.0 Request processed in 127us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390631.885765:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788390631.885771:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103293952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.885806:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103293952:12345-0@lo:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390631.885819:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1788390631.885851:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390631.885856:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390631.885867:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788390631.885888:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103293824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390631.885897:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103294336:0@lo:400:kworker.0 00000100:00100000:0.0:1788390631.885898:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103293952:0@lo:400:kworker.0 00000100:00100000:0.0:1788390631.885906:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103294464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390631.886169:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103294592:0@lo:400:kworker.0 00000100:00100000:3.0:1788390631.886196:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390631.886203:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294208 00000100:00100000:2.0:1788390631.886209:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294208 00000100:00100000:0.0:1788390631.886245:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294080 00000100:00100000:0.0:1788390631.886251:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294080 00000100:00100000:2.0:1788390631.886255:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390631.886265:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103294208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390631.886290:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390631.886300:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103294080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390631.886312:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103294208:12345-0@lo:400:kworker.0 Request processed in 48us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390631.886320:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788390631.886351:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103294080:12345-0@lo:400:kworker.0 Request processed in 53us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390631.886353:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103294208:0@lo:400:kworker.0 00000100:00100000:0.0:1788390631.886362:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788390631.886423:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103294080:0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.886736:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294592 00000100:00100000:1.0:1788390631.886740:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294592 00000100:00100000:1.0:1788390631.886772:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390631.886780:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103294592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390631.886826:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103294592:12345-0@lo:400:kworker.0 Request processed in 48us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390631.886831:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788390631.886847:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390631.886850:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390631.886863:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103294592:0@lo:400:kworker.0 00000040:00080000:0.0:1788390632.269824:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390632.269832:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390632.271136:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390632.271149:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390632.526034:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390632.744352:0:20226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390632.744362:0:20226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390632.746458:0:20226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390632.746472:0:20226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390633.549130:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390634.216441:0:20277:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390634.216448:0:20277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390634.216946:0:20277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390634.216953:0:20277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390634.445202:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103294720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390634.445275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390634.445341:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294720 00000100:00100000:2.0:1788390634.445351:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294720 00000100:00100000:2.0:1788390634.445414:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788390634.445424:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103294720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390634.445458:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788390634.445459:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390634.445518:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103294720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390634.445542:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390634.445594:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103294720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390634.573446:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390634.614350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390634.614424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390634.614522:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888384 00000100:00100000:3.0:1788390634.614535:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888384 00000100:00100000:3.0:1788390634.614616:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:3.0:1788390634.614628:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093888384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390634.614726:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093888384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390634.614734:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1788390634.614821:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888512 00000100:00100000:1.0:1788390634.614826:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888512 00000100:00100000:1.0:1788390634.614876:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:1.0:1788390634.614885:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093888512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390634.614916:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093888512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390634.614922:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00080000:3.0:1788390634.615941:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390634.619499:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390634.619547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390634.619623:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888768 00000100:00100000:0.0:1788390634.619632:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888768 00000100:00100000:0.0:1788390634.619711:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:0.0:1788390634.619721:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093888768:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390634.619793:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093888768:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390634.619800:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1788390634.620387:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888640 00000100:00100000:2.0:1788390634.620392:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888640 00000100:00100000:2.0:1788390634.620438:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788390634.620446:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093888640:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390634.620503:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093888640:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390634.620510:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00080000:3.0:1788390634.620900:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390634.620905:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788390635.597107:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390635.720848:0:20328:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390635.720856:0:20328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390635.721519:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390635.721530:0:20328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390636.621303:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390637.005132:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103294848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390637.005204:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390637.005244:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294848 00000100:00100000:2.0:1788390637.005252:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294848 00000100:00100000:2.0:1788390637.005315:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390637.005326:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103294848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390637.005361:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390637.005463:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103294848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390637.005586:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103294848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390637.005588:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788390637.005609:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390637.007005:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103295104:0@lo:400:kworker.0 00000100:00100000:2.0:1788390637.007051:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103294976:0@lo:400:kworker.0 00000100:00100000:3.0:1788390637.007062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390637.007062:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103295232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390637.007096:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390637.007105:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103295360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390637.007106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390637.007122:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295104 00000100:00100000:3.0:1788390637.007127:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295104 00000100:00100000:2.0:1788390637.007130:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103295488:0@lo:400:kworker.0 00000100:00100000:0.0:1788390637.007151:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390637.007170:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295232 00000100:00100000:2.0:1788390637.007174:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103294976 00000100:00100000:1.0:1788390637.007177:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295232 00000100:00100000:2.0:1788390637.007180:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103294976 00000100:00100000:3.0:1788390637.007199:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788390637.007204:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295360 00000100:00100000:3.0:1788390637.007210:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103295104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390637.007211:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295360 00000100:00100000:1.0:1788390637.007224:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390637.007227:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788390637.007237:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103295232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390637.007239:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103294976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390637.007255:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788390637.007263:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103295104:12345-0@lo:400:kworker.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390637.007268:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103295360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390637.007284:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788390637.007289:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103295232:12345-0@lo:400:kworker.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390637.007298:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390637.007308:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103294976:12345-0@lo:400:kworker.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390637.007317:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788390637.007329:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103295360:12345-0@lo:400:kworker.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390637.007349:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103295232:0@lo:400:kworker.0 00000100:00100000:0.0:1788390637.007349:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788390637.007384:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390637.007395:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103295360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390637.007416:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295488 00000100:00100000:1.0:1788390637.007421:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295488 00000100:00100000:2.0:1788390637.007423:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103294976:0@lo:400:kworker.0 00000100:00100000:1.0:1788390637.007459:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788390637.007467:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103295488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390637.007514:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103295488:12345-0@lo:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390637.007520:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788390637.007687:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390637.007692:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390637.007719:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103295104:0@lo:400:kworker.0 00000100:00100000:2.0:1788390637.008293:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103295488:0@lo:400:kworker.0 00000040:00080000:3.0:1788390637.178418:0:20379:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390637.178428:0:20379:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390637.179026:0:20379:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390637.179038:0:20379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390637.645146:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390638.670424:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390638.816794:0:20431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390638.816807:0:20431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390638.817597:0:20431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390638.817609:0:20431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390639.565206:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103295616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390639.565282:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390639.565419:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295616 00000100:00100000:1.0:1788390639.565429:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295616 00000100:00100000:1.0:1788390639.565496:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390639.565506:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103295616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390639.565550:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788390639.565728:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390639.574796:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103295616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9281us (9504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390639.574827:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390639.575067:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103295616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390639.696786:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390639.732995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390639.733037:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390639.733066:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390639.733095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390639.733161:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889024 00000100:00100000:3.0:1788390639.733171:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889024 00000100:00100000:3.0:1788390639.733227:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889280 00000100:00100000:3.0:1788390639.733231:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889280 00000100:00100000:3.0:1788390639.733253:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:3.0:1788390639.733263:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093889024:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390639.733264:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093888896 00000100:00100000:0.0:1788390639.733268:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093888896 00000100:00100000:0.0:1788390639.733298:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1788390639.733304:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093888896:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390639.733493:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1788390639.733511:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093889280:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:1.0:1788390639.733602:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390639.733630:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889152 00000100:00100000:1.0:1788390639.733634:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889152 00000100:00100000:1.0:1788390639.733667:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390639.733674:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093889152:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390639.733711:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093889024:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390639.733720:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1788390639.734920:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093888896:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1609us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390639.734945:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00080000:0.0:1788390639.735010:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390639.735936:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093889280:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2431us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390639.735955:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:1.0:1788390639.736092:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093889152:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2416us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390639.736101:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000040:00080000:0.0:1788390640.362163:0:20482:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390640.362175:0:20482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390640.362828:0:20482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390640.362839:0:20482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390640.717155:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390641.742278:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390641.988607:0:20533:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390641.988618:0:20533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390641.989238:0:20533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390641.989247:0:20533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390642.125284:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103296128:0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.125354:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390642.125414:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390642.125421:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103296000:0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.125447:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390642.125483:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296128 00000100:00100000:0.0:1788390642.125491:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296128 00000100:00100000:0.0:1788390642.125553:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390642.125562:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103296128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.125611:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103296128:12345-0@lo:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390642.125619:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390642.125642:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296000 00000100:00100000:0.0:1788390642.125646:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296000 00000100:00100000:0.0:1788390642.125678:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788390642.125684:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103296000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.125713:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103296000:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390642.125719:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788390642.125736:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390642.125782:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103296000:0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.125791:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103296128:0@lo:400:kworker.0 00000100:00100000:1.0:1788390642.126895:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103295744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390642.126944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390642.127007:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295744 00000100:00100000:3.0:1788390642.127013:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295744 00000100:00100000:1.0:1788390642.127015:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103296256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390642.127049:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390642.127056:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788390642.127063:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103295744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390642.127077:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788390642.127087:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103295872:0@lo:400:kworker.0 00000100:00100000:3.0:1788390642.127100:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103295744:12345-0@lo:400:kworker.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390642.127106:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788390642.127119:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390642.127139:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103296384:0@lo:400:kworker.0 00000100:00100000:1.0:1788390642.127161:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390642.127188:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103295744:0@lo:400:kworker.0 00000100:00100000:3.0:1788390642.127244:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296256 00000100:00100000:3.0:1788390642.127249:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296256 00000100:00100000:3.0:1788390642.127295:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296384 00000100:00100000:3.0:1788390642.127298:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296384 00000100:00080000:1.0:1788390642.127320:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390642.127322:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788390642.127329:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103295872 00000100:00100000:3.0:1788390642.127332:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103296256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.127335:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103295872 00000100:00100000:3.0:1788390642.127379:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103296256:12345-0@lo:400:kworker.0 Request processed in 49us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390642.127387:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788390642.127393:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788390642.127405:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390642.127406:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103295872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390642.127417:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103296384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.127450:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103295872:12345-0@lo:400:kworker.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390642.127463:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103296384:12345-0@lo:400:kworker.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390642.127470:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390642.127472:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788390642.127502:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103296512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390642.127516:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103295872:0@lo:400:kworker.0 00000100:00100000:3.0:1788390642.127534:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103296384:0@lo:400:kworker.0 00000100:00100000:0.0:1788390642.127545:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390642.127548:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103296256:0@lo:400:kworker.0 00000100:00100000:2.0:1788390642.127591:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296512 00000100:00100000:2.0:1788390642.127597:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296512 00000100:00100000:3.0:1788390642.127714:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390642.127720:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103296512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390642.127744:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390642.127775:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103296512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390642.127779:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788390642.127881:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103296512:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788390642.128572:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788390642.510716:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390642.510725:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390642.511151:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390642.511161:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390642.769608:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390643.578133:0:20584:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390643.578145:0:20584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390643.584810:0:20584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390643.584822:0:20584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390643.789111:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390644.690399:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103296640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390644.690500:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390644.690771:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296640 00000100:00100000:0.0:1788390644.690783:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296640 00000100:00100000:0.0:1788390644.690874:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390644.690886:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103296640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390644.690934:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788390644.691038:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390644.691227:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103296640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 342us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390644.691243:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390644.693062:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103296640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390644.813187:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390644.860746:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390644.860791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390644.860819:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390644.860845:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390644.860884:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889408 00000100:00100000:0.0:1788390644.860896:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889408 00000100:00100000:0.0:1788390644.860978:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:0.0:1788390644.860991:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093889408:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390644.861079:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093889408:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390644.861087:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:0.0:1788390644.861126:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889536 00000100:00100000:0.0:1788390644.861130:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889536 00000100:00100000:0.0:1788390644.861168:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889792 00000100:00100000:0.0:1788390644.861171:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889792 00000100:00100000:0.0:1788390644.861194:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1788390644.861201:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093889536:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390644.861232:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093889536:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390644.861238:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1788390644.861250:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1788390644.861257:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093889792:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390644.861277:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093889792:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390644.861295:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1788390644.861315:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889664 00000100:00100000:0.0:1788390644.861319:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889664 00000100:00100000:0.0:1788390644.861349:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788390644.861355:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093889664:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390644.861382:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093889664:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390644.861389:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00080000:0.0:1788390644.861530:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390644.861535:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788390645.152154:0:20635:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390645.152166:0:20635:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390645.152777:0:20635:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390645.152788:0:20635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390645.837320:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390646.808828:0:20687:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390646.808840:0:20687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390646.809403:0:20687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390646.809415:0:20687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390646.865106:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390647.246607:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103296768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390647.246689:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390647.246769:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296768 00000100:00100000:0.0:1788390647.246779:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296768 00000100:00100000:0.0:1788390647.246856:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788390647.246867:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103296768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390647.246906:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390647.246989:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103296768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390647.246997:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788390647.247018:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390647.247230:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103296768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390647.247500:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103296896:0@lo:400:kworker.0 00000100:00100000:1.0:1788390647.247563:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390647.247713:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103296896 00000100:00100000:3.0:1788390647.247719:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103296896 00000100:00100000:3.0:1788390647.247763:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788390647.247771:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103296896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248050:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248084:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390647.248115:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297280 00000100:00100000:0.0:1788390647.248128:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297280 00000100:00100000:0.0:1788390647.248165:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788390647.248173:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103297280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248211:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103297280:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390647.248218:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788390647.248241:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390647.248262:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248294:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103297024:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390647.248341:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390647.248345:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248359:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390647.248376:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297024 00000100:00100000:0.0:1788390647.248378:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297024 00000100:00100000:0.0:1788390647.248398:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788390647.248418:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103297024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248443:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103297024:12345-0@lo:400:kworker.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390647.248446:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788390647.248458:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297152 00000100:00100000:0.0:1788390647.248471:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297152 00000100:00100000:0.0:1788390647.248492:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788390647.248504:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103297152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248535:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103297152:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390647.248541:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788390647.248573:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390647.248591:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248600:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103297024:0@lo:400:kworker.0 00000100:00100000:3.0:1788390647.248606:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103296896:12345-0@lo:400:kworker.0 Request processed in 835us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390647.248613:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788390647.248708:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390647.248716:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788390647.248742:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390647.248804:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103296896:0@lo:400:kworker.0 00000100:00100000:2.0:1788390647.248911:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297408 00000100:00100000:2.0:1788390647.248916:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297408 00000100:00100000:2.0:1788390647.249046:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788390647.249054:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103297408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390647.249091:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103297408:12345-0@lo:400:kworker.0 Request processed in 39us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390647.249098:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788390647.249212:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103297408:0@lo:400:kworker.0 00000100:00080000:0.0:1788390647.249249:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390647.885945:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390648.541548:0:20738:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390648.541559:0:20738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390648.542317:0:20738:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390648.542330:0:20738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390648.909744:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390649.805228:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390649.805250:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103297536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390649.805321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390649.805420:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297536 00000100:00100000:2.0:1788390649.805427:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297536 00000100:00100000:2.0:1788390649.805498:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390649.805508:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103297536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390649.805542:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390649.805590:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103297536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390649.805597:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390649.805641:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103297536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390649.805750:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390649.933149:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390649.973450:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390649.973490:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390649.973516:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390649.973548:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390649.973575:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093889920 00000100:00100000:3.0:1788390649.973585:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093889920 00000100:00100000:3.0:1788390649.973639:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:3.0:1788390649.973649:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093889920:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390649.973716:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc715050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093889920:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 67us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390649.973725:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:3.0:1788390649.973764:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890176 00000100:00100000:3.0:1788390649.973768:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890176 00000100:00100000:3.0:1788390649.973818:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788390649.973840:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093890176:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390649.973872:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093890176:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390649.973878:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788390649.973901:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890048 00000100:00100000:3.0:1788390649.973905:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890048 00000100:00100000:3.0:1788390649.973939:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890304 00000100:00100000:3.0:1788390649.973942:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890304 00000100:00100000:3.0:1788390649.973992:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:3.0:1788390649.974000:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093890048:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390649.974030:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093890048:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390649.974038:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:3.0:1788390649.974055:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788390649.974062:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093890304:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390649.974101:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093890304:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390649.974108:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00080000:3.0:1788390649.974227:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390649.974232:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788390650.055360:0:20789:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390650.055369:0:20789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390650.056404:0:20789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390650.056414:0:20789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390650.957195:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390651.613505:0:20840:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390651.613515:0:20840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390651.614247:0:20840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390651.614257:0:20840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390651.981777:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390652.365236:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390652.367037:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103297792:0@lo:400:kworker.0 00000100:00100000:1.0:1788390652.367130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390652.367184:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390652.367188:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788390652.367208:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390652.367234:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297792 00000100:00100000:1.0:1788390652.367241:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297792 00000100:00100000:1.0:1788390652.367286:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788390652.367295:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103297792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390652.367330:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103297792:12345-0@lo:400:kworker.0 Request processed in 37us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390652.367335:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788390652.367357:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297920 00000100:00100000:1.0:1788390652.367359:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297920 00000100:00100000:1.0:1788390652.367384:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390652.367388:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103297920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390652.367412:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103297920:12345-0@lo:400:kworker.0 Request processed in 22us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390652.367427:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390652.367468:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788390652.367475:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103297792:0@lo:400:kworker.0 00000100:00080000:2.0:1788390652.367548:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390652.370508:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103298048:0@lo:400:kworker.0 00000100:00100000:3.0:1788390652.370582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390652.370688:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390652.370706:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390652.370826:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103297664 00000100:00100000:1.0:1788390652.370833:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103297664 00000100:00100000:1.0:1788390652.370906:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390652.370916:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103297664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390652.370952:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390652.371026:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103297664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390652.371047:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788390652.371216:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390652.371249:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390652.371388:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103298304:0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.371423:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390652.371447:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390652.371453:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103298432:0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.371472:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390652.371492:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298304 00000100:00100000:0.0:1788390652.371495:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298304 00000100:00100000:0.0:1788390652.371520:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298432 00000100:00100000:0.0:1788390652.371522:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298432 00000100:00100000:0.0:1788390652.371542:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390652.371549:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103298304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.371585:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103298304:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390652.371591:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390652.371605:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788390652.371611:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103298432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.371642:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103298432:12345-0@lo:400:kworker.0 Request processed in 32us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390652.371646:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788390652.371663:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390652.371674:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103298432:0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.371680:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103298304:0@lo:400:kworker.0 00000100:00100000:3.0:1788390652.371806:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390652.371813:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103298176:0@lo:400:kworker.0 00000100:00100000:3.0:1788390652.371832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390652.372018:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298176 00000100:00100000:0.0:1788390652.372021:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298176 00000100:00100000:0.0:1788390652.372045:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788390652.372050:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390652.372155:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103298176:12345-0@lo:400:kworker.0 Request processed in 105us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390652.372160:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788390652.372206:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103298176:0@lo:400:kworker.0 00000100:00100000:2.0:1788390652.372258:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298048 00000100:00100000:2.0:1788390652.372262:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298048 00000100:00100000:2.0:1788390652.372325:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788390652.372331:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103298048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390652.372370:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103298048:12345-0@lo:400:kworker.0 Request processed in 40us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390652.372374:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788390652.372425:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103298048:0@lo:400:kworker.0 00000040:00080000:0.0:1788390652.749288:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390652.749298:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390652.749804:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390652.749815:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390653.005287:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390653.146483:0:20892:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390653.146493:0:20892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390653.147135:0:20892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390653.147145:0:20892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390654.033634:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390654.644179:0:20943:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390654.644189:0:20943:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390654.646891:0:20943:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390654.646911:0:20943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390654.929296:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390654.929321:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390654.929410:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390654.929587:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298560 00000100:00100000:2.0:1788390654.929596:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298560 00000100:00100000:2.0:1788390654.929658:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788390654.929669:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103298560:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390654.929692:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788390654.929705:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390654.929760:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103298560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390654.929766:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390654.929813:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103298560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390655.053192:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390655.098724:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390655.098768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390655.098811:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390655.098854:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390655.098928:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890560 00000100:00100000:3.0:1788390655.098938:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890560 00000100:00100000:3.0:1788390655.099023:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890816 00000100:00100000:3.0:1788390655.099026:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890816 00000100:00100000:3.0:1788390655.099047:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:3.0:1788390655.099056:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093890560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390655.099123:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093890560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390655.099131:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:3.0:1788390655.099146:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:3.0:1788390655.099152:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093890816:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390655.099173:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093890816:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390655.099178:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:1.0:1788390655.099369:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890688 00000100:00100000:1.0:1788390655.099374:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890688 00000100:00100000:1.0:1788390655.099427:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788390655.099434:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093890688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390655.099464:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093890688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390655.099469:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00080000:0.0:1788390655.099667:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390655.099672:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390655.099753:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890432 00000100:00100000:2.0:1788390655.099758:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890432 00000100:00100000:2.0:1788390655.099795:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1788390655.099802:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093890432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390655.099836:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093890432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390655.099841:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00010000:00010000:2.0:1788390656.078799:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390656.211663:0:20994:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390656.211672:0:20994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390656.212569:0:20994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390656.212582:0:20994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390657.101196:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390657.486401:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103299072:0@lo:400:kworker.0 00000100:00100000:3.0:1788390657.486505:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103298688:0@lo:400:kworker.0 00000100:00100000:0.0:1788390657.486505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390657.491254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390657.491268:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103298816:0@lo:400:kworker.0 00000100:00100000:1.0:1788390657.491888:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103298944:0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.493476:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298688 00000100:00100000:0.0:1788390657.493476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390657.493504:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298688 00000100:00100000:0.0:1788390657.493544:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103299328:0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.493563:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788390657.493573:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103298688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390657.493586:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390657.493633:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299072 00000100:00100000:2.0:1788390657.493637:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103298688:12345-0@lo:400:kworker.0 Request processed in 65us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390657.493637:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299072 00000100:00100000:2.0:1788390657.493644:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788390657.493667:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299328 00000100:00100000:0.0:1788390657.493669:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299328 00000100:00100000:0.0:1788390657.493699:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788390657.493706:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103299072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390657.493748:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103299072:12345-0@lo:400:kworker.0 Request processed in 43us (7246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390657.493754:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788390657.493767:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788390657.493773:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103299328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.493789:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298816 00000100:00100000:2.0:1788390657.493793:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298816 00000100:00100000:0.0:1788390657.493804:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103299328:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390657.493810:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788390657.493821:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788390657.493826:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390657.493827:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103298816:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390657.493831:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390657.493872:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103299072:0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.493988:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103298816:12345-0@lo:400:kworker.0 Request processed in 160us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390657.493996:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788390657.494004:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103299328:0@lo:400:kworker.0 00000100:00100000:0.0:1788390657.494021:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103298816:0@lo:400:kworker.0 00000100:00100000:1.0:1788390657.494092:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390657.494140:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103299456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390657.494169:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390657.494202:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299456 00000100:00100000:1.0:1788390657.494206:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299456 00000100:00100000:1.0:1788390657.494243:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390657.494251:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103299456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390657.494297:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390657.494431:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103298944 00000100:00100000:2.0:1788390657.494436:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103298944 00000100:00100000:2.0:1788390657.494462:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788390657.494464:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390657.494469:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103298944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390657.494530:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103299456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390657.494553:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788390657.494763:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103298944:12345-0@lo:400:kworker.0 Request processed in 294us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390657.494769:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788390657.495626:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103298688:0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.495643:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103299200:0@lo:400:kworker.0 00000100:00100000:2.0:1788390657.495701:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390657.495832:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299200 00000100:00100000:1.0:1788390657.495839:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299200 00000100:00100000:1.0:1788390657.495947:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788390657.495957:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103299200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390657.496043:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103299200:12345-0@lo:400:kworker.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390657.496051:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788390657.496088:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103299200:0@lo:400:kworker.0 00000100:00080000:2.0:1788390657.496195:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390657.496330:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103298944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390657.496382:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103299456:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788390657.874235:0:21045:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390657.874246:0:21045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390657.874796:0:21045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390657.874807:0:21045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390658.125132:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390659.150561:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390659.447930:0:21096:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390659.447939:0:21096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390659.450089:0:21096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390659.450101:0:21096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390660.045412:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103299584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390660.045587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390660.047459:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299584 00000100:00100000:0.0:1788390660.047472:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299584 00000100:00100000:0.0:1788390660.047557:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390660.047567:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103299584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390660.047605:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788390660.048072:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390660.051466:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103299584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3890us (5870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390660.051481:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390660.052857:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103299584:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390660.181857:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390660.213474:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390660.213538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390660.213678:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390660.213755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390660.213791:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891072 00000100:00100000:3.0:1788390660.213801:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891072 00000100:00100000:3.0:1788390660.213874:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891328 00000100:00100000:3.0:1788390660.213878:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891328 00000100:00100000:3.0:1788390660.213902:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:3.0:1788390660.213912:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093891072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390660.214021:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093891072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390660.214029:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:3.0:1788390660.214046:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:3.0:1788390660.214052:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093891328:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390660.214076:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093891328:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390660.214081:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00080000:3.0:1788390660.214194:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390660.214328:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093890944 00000100:00100000:1.0:1788390660.214333:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093890944 00000100:00100000:1.0:1788390660.214386:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:1.0:1788390660.214395:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093890944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390660.214439:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093890944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390660.214445:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:2.0:1788390660.214616:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891200 00000100:00100000:2.0:1788390660.214621:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891200 00000100:00080000:3.0:1788390660.214649:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390660.214675:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788390660.214683:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093891200:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390660.214716:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093891200:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390660.214723:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000040:00080000:0.0:1788390661.101186:0:21148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390661.101195:0:21148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390661.103319:0:21148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390661.103462:0:21148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390661.205446:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390662.228753:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390662.610312:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390662.610412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390662.610493:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299712 00000100:00100000:1.0:1788390662.610501:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299712 00000100:00100000:1.0:1788390662.610564:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390662.610574:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103299712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390662.610610:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390662.610655:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103299712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390662.610670:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788390662.610693:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390662.610730:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390662.614519:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103300096:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.614586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390662.614629:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390662.614635:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103300224:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.614657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390662.614684:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103299840:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.614708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390662.614731:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103300352:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.614744:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390662.614797:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390662.614803:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.614828:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390662.614855:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300096 00000100:00100000:3.0:1788390662.614861:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300096 00000100:00100000:3.0:1788390662.614902:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300224 00000100:00100000:3.0:1788390662.614906:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300224 00000100:00100000:3.0:1788390662.614935:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300352 00000100:00100000:3.0:1788390662.614938:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300352 00000100:00100000:3.0:1788390662.614976:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788390662.614987:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103300096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615040:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103300096:12345-0@lo:400:kworker.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390662.615048:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788390662.615066:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788390662.615072:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103300224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615100:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103300224:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390662.615104:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788390662.615113:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788390662.615117:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103300352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615137:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103300352:12345-0@lo:400:kworker.0 Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390662.615140:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788390662.615155:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299840 00000100:00100000:3.0:1788390662.615162:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299840 00000100:00100000:3.0:1788390662.615193:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390662.615199:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103299840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615238:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103299840:12345-0@lo:400:kworker.0 Request processed in 40us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390662.615243:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390662.615264:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103299968 00000100:00100000:3.0:1788390662.615267:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103299968 00000100:00100000:3.0:1788390662.615285:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390662.615289:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103299968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615308:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103299968:12345-0@lo:400:kworker.0 Request processed in 19us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390662.615314:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390662.615372:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103300224:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615384:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103300096:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615424:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615429:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103299840:0@lo:400:kworker.0 00000100:00100000:3.0:1788390662.615435:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103300352:0@lo:400:kworker.0 00000100:00080000:1.0:1788390662.615524:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390662.615528:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788390662.698038:0:21199:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390662.698048:0:21199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390662.698733:0:21199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390662.698741:0:21199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788390662.989161:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390662.989171:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390662.989674:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390662.989684:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390663.245469:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390664.260186:0:21250:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390664.260197:0:21250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390664.260685:0:21250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390664.260693:0:21250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390664.270364:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390665.165181:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390665.165275:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390665.165409:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300480 00000100:00100000:1.0:1788390665.165417:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300480 00000100:00100000:1.0:1788390665.165482:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788390665.165490:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103300480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390665.165521:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788390665.166259:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390665.166268:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103300480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 775us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390665.166278:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788390665.167810:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103300480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390665.293126:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390665.343593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390665.343705:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390665.343752:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390665.343801:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390665.343834:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891584 00000100:00100000:3.0:1788390665.343843:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891584 00000100:00100000:3.0:1788390665.343922:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891840 00000100:00100000:3.0:1788390665.343926:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891840 00000100:00100000:3.0:1788390665.343950:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788390665.343990:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093891584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390665.344059:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093891584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390665.344066:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788390665.344084:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1788390665.344089:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093891840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390665.344112:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093891840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390665.344118:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788390665.344269:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891712 00000100:00100000:2.0:1788390665.344273:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891712 00000100:00100000:2.0:1788390665.344327:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1788390665.344334:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093891712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390665.344359:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093891712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390665.344376:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00080000:0.0:1788390665.344545:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390665.344550:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390665.344844:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891456 00000100:00100000:1.0:1788390665.344849:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891456 00000100:00100000:1.0:1788390665.344931:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:1.0:1788390665.344940:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093891456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390665.345000:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093891456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390665.345007:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000040:00080000:0.0:1788390665.878222:0:21301:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390665.878233:0:21301:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390665.878661:0:21301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390665.878668:0:21301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390666.317143:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390667.342270:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390667.450803:0:21353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390667.450813:0:21353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390667.451679:0:21353:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390667.451694:0:21353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390667.725508:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103300864:0@lo:400:kworker.0 00000100:00100000:2.0:1788390667.725634:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390667.725693:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300864 00000100:00100000:2.0:1788390667.725699:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103301376:0@lo:400:kworker.0 00000100:00100000:0.0:1788390667.725702:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300864 00000100:00100000:2.0:1788390667.725731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390667.725761:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390667.725768:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103300992:0@lo:400:kworker.0 00000100:00100000:0.0:1788390667.725782:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788390667.725795:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103300864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390667.725799:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390667.725846:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301376 00000100:00100000:2.0:1788390667.725850:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301376 00000100:00100000:0.0:1788390667.725863:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103300864:12345-0@lo:400:kworker.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390667.725871:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788390667.725891:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300992 00000100:00100000:2.0:1788390667.725894:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788390667.725903:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103301376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390667.725937:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103301376:12345-0@lo:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390667.725942:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788390667.726010:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103300864:0@lo:400:kworker.0 00000100:00100000:2.0:1788390667.726021:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103301376:0@lo:400:kworker.0 00000100:00080000:2.0:1788390667.726054:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390667.726059:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390667.726194:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103300736:0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726228:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390667.726262:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103301120:0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390667.726315:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390667.726336:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390667.726386:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390667.726403:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103301248:0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390667.726458:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301120 00000100:00100000:3.0:1788390667.726463:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301120 00000100:00100000:3.0:1788390667.726493:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301248 00000100:00100000:3.0:1788390667.726496:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301248 00000100:00100000:3.0:1788390667.726533:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788390667.726541:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103301120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726578:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103301120:12345-0@lo:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390667.726585:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788390667.726599:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788390667.726604:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103301248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726630:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103301248:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390667.726635:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788390667.726670:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103301248:0@lo:400:kworker.0 00000100:00100000:3.0:1788390667.726679:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103301120:0@lo:400:kworker.0 00000100:00100000:0.0:1788390667.726724:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300992 00000100:00100000:0.0:1788390667.726759:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788390667.726765:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390667.726801:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103300992:12345-0@lo:400:kworker.0 Request processed in 35us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390667.726807:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788390667.726895:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300736 00000100:00100000:2.0:1788390667.726899:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300736 00000100:00100000:2.0:1788390667.726934:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788390667.726941:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103300736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390667.727011:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103300736:12345-0@lo:400:kworker.0 Request processed in 71us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390667.727024:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788390667.727056:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103300608 00000100:00100000:2.0:1788390667.727059:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103300608 00000100:00100000:2.0:1788390667.727086:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788390667.727094:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103300608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390667.727122:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390667.727154:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103300608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390667.727161:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788390667.727186:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390667.727190:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390667.727213:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103300992:0@lo:400:kworker.0 00000100:00100000:0.0:1788390667.727621:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390667.727631:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103300736:0@lo:400:kworker.0 00010000:00010000:3.0:1788390668.365183:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390669.136350:0:21404:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390669.136362:0:21404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390669.137143:0:21404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390669.137156:0:21404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390669.393665:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390670.286656:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390670.287505:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390670.287583:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390670.290525:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301504 00000100:00100000:2.0:1788390670.290540:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301504 00000100:00100000:2.0:1788390670.290630:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788390670.290643:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103301504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390670.290683:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788390670.290875:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390670.290947:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390670.292357:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103301504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1710us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390670.292371:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:2.0:1788390670.416361:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390670.453268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390670.453547:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390670.453601:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390670.453620:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892224 00000100:00100000:0.0:1788390670.453631:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892224 00000100:00100000:3.0:1788390670.453648:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390670.453675:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892096 00000100:00100000:3.0:1788390670.453680:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892096 00000100:00100000:3.0:1788390670.453718:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892352 00000100:00100000:3.0:1788390670.453722:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892352 00000100:00100000:0.0:1788390670.453737:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788390670.453749:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1788390670.453752:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093892224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390670.453762:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093892096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390670.453832:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093892224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390670.453841:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788390670.453844:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093891968 00000100:00100000:1.0:1788390670.453849:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093891968 00000100:00100000:1.0:1788390670.453885:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:1.0:1788390670.453900:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093891968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390670.454387:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093892096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 627us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390670.454396:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:3.0:1788390670.454416:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1788390670.454423:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093892352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390670.454453:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093892352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390670.454460:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00080000:3.0:1788390670.454483:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390670.454487:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390670.454775:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093891968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 875us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390670.454783:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000040:00080000:2.0:1788390670.862585:0:21455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390670.862599:0:21455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390670.863838:0:21455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390670.863851:0:21455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390671.437402:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390672.211422:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390672.211432:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390672.212105:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390672.212118:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390672.461214:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390672.511639:0:21506:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390672.511649:0:21506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390672.512733:0:21506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390672.512747:0:21506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390672.845463:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103301632:0@lo:400:kworker.0 00000100:00100000:0.0:1788390672.845542:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390672.845885:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301632 00000100:00100000:3.0:1788390672.845894:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301632 00000100:00100000:3.0:1788390672.845947:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788390672.845982:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103301632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.846709:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103301888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390672.846751:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390672.846808:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301888 00000100:00100000:1.0:1788390672.846812:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301888 00000100:00100000:1.0:1788390672.846857:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390672.846864:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103301888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390672.846896:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390672.846933:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103301888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390672.846941:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390672.846981:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103301760:0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.847012:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390672.847065:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103301888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390672.847093:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103301760 00000100:00100000:1.0:1788390672.847097:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103301760 00000100:00100000:1.0:1788390672.847125:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390672.847132:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103301760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.847176:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103301760:12345-0@lo:400:kworker.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390672.847183:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390672.847209:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103301760:0@lo:400:kworker.0 00000100:00080000:1.0:1788390672.847281:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390672.847285:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390672.848121:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390672.848142:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103302016:0@lo:400:kworker.0 00000100:00100000:2.0:1788390672.848187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390672.848218:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302016 00000100:00100000:2.0:1788390672.848223:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302016 00000100:00100000:2.0:1788390672.848266:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788390672.848273:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103302016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390672.848310:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103302016:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390672.848316:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788390672.848347:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103302016:0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.849350:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103302272:0@lo:400:kworker.0 00000100:00100000:3.0:1788390672.850312:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103301632:12345-0@lo:400:kworker.0 Request processed in 4350us (4763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390672.850338:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390672.850339:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788390672.850390:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302272 00000100:00100000:3.0:1788390672.850397:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302272 00000100:00100000:3.0:1788390672.850443:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788390672.850451:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103302272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390672.850494:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103302272:12345-0@lo:400:kworker.0 Request processed in 44us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390672.850500:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1788390672.850518:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390672.851324:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103302272:0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.851346:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390672.851354:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103302144:0@lo:400:kworker.0 00000100:00100000:1.0:1788390672.851566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390672.851864:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302144 00000100:00100000:3.0:1788390672.851870:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302144 00000100:00100000:3.0:1788390672.851922:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390672.851930:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103302144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390672.851992:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103302144:12345-0@lo:400:kworker.0 Request processed in 62us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390672.851998:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390672.852021:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103302144:0@lo:400:kworker.0 00000100:00080000:1.0:1788390672.853418:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390672.854444:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103301632:0@lo:400:kworker.0 00010000:00010000:2.0:1788390673.485131:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390674.060172:0:21557:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390674.060179:0:21557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390674.060767:0:21557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390674.060776:0:21557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390674.509184:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390675.406832:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390675.406907:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390675.407060:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302400 00000100:00100000:0.0:1788390675.407069:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302400 00000100:00100000:0.0:1788390675.407137:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390675.407147:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103302400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390675.407181:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390675.407247:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103302400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390675.407255:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788390675.407314:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390675.407351:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390675.533079:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390675.565191:0:21610:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390675.565201:0:21610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390675.565674:0:21610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390675.565683:0:21610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390675.573186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390675.573238:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390675.573285:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892608 00000100:00100000:2.0:1788390675.573296:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892608 00000100:00100000:2.0:1788390675.573376:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:2.0:1788390675.573390:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093892608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390675.573478:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093892608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390675.573497:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00080000:1.0:1788390675.573651:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390675.574181:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390675.574183:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892480 00000100:00100000:2.0:1788390675.574189:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892480 00000100:00100000:2.0:1788390675.574234:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:2.0:1788390675.574244:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093892480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390675.574261:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390675.574278:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093892480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390675.574286:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:1.0:1788390675.574347:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892864 00000100:00100000:1.0:1788390675.574352:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892864 00000100:00100000:1.0:1788390675.574397:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:1.0:1788390675.574405:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093892864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390675.574439:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093892864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00080000:2.0:1788390675.574441:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390675.574454:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:0.0:1788390675.574559:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892736 00000100:00100000:0.0:1788390675.574564:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892736 00000100:00080000:2.0:1788390675.574663:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390675.574664:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788390675.574672:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093892736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390675.574712:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093892736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390675.574719:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00010000:00010000:2.0:1788390676.557221:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390677.059350:0:21661:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390677.059360:0:21661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390677.059898:0:21661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390677.059909:0:21661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390677.581362:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390677.965145:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390677.965170:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302912:0@lo:400:kworker.0 00000100:00100000:2.0:1788390677.965253:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390677.965318:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390677.965342:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390677.965362:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390677.965368:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103303040:0@lo:400:kworker.0 00000100:00100000:0.0:1788390677.965391:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103302656:0@lo:400:kworker.0 00000100:00100000:2.0:1788390677.965399:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390677.965423:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302912 00000100:00100000:0.0:1788390677.965430:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390677.965433:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302912 00000100:00100000:2.0:1788390677.965438:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302528 00000100:00100000:2.0:1788390677.965444:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302528 00000100:00100000:2.0:1788390677.965501:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788390677.965501:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788390677.965520:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103302528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390677.965520:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103302912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390677.965524:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103303168:0@lo:400:kworker.0 00000100:00100000:0.0:1788390677.965550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390677.965569:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390677.965574:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103302784:0@lo:400:kworker.0 00002000:00000024:2.0:1788390677.965582:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390677.965592:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103302912:12345-0@lo:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390677.965598:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390677.965609:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788390677.965618:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bcb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103303296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390677.965629:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302784 00000100:00100000:1.0:1788390677.965634:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302784 00000100:00100000:0.0:1788390677.965641:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390677.965650:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103302528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390677.965660:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788390677.965665:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788390677.965674:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103302784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390677.965713:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103302784:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390677.965721:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788390677.965729:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103302784:0@lo:400:kworker.0 00000100:00080000:0.0:1788390677.965789:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390677.965792:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390677.965849:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103302656 00000100:00100000:3.0:1788390677.965855:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103302656 00000100:00100000:3.0:1788390677.965887:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788390677.965893:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103302656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.965924:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103302656:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390677.965928:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788390677.965976:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103302656:0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966014:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302912:0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966027:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390677.966419:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303040 00000100:00100000:2.0:1788390677.966424:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303040 00000100:00100000:2.0:1788390677.966459:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303168 00000100:00100000:2.0:1788390677.966462:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303168 00000100:00100000:2.0:1788390677.966488:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303296 00000100:00100000:2.0:1788390677.966492:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303296 00000100:00100000:2.0:1788390677.966507:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788390677.966514:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103303040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966550:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788390677.966559:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103303168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966600:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103303168:12345-0@lo:400:kworker.0 Request processed in 43us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390677.966606:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788390677.966634:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788390677.966640:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103303296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966668:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103303296:12345-0@lo:400:kworker.0 Request processed in 29us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390677.966674:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788390677.966702:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bcb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103303296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390677.966713:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103303168:0@lo:400:kworker.0 00000100:00080000:3.0:1788390677.966735:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390677.966765:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103303040:12345-0@lo:400:kworker.0 Request processed in 250us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390677.966775:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103303040:0@lo:400:kworker.0 00000100:00100000:2.0:1788390677.966776:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:3.0:1788390678.606533:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390678.700120:0:21712:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390678.700131:0:21712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390678.701302:0:21712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390678.701312:0:21712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390679.630006:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390680.280051:0:21763:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390680.280060:0:21763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390680.281009:0:21763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390680.281021:0:21763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390680.526432:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103303424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390680.526519:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390680.526919:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303424 00000100:00100000:2.0:1788390680.526928:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303424 00000100:00100000:2.0:1788390680.527051:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390680.527062:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103303424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390680.527096:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390680.527155:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103303424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390680.527172:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788390680.527295:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390680.528129:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103303424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390680.653488:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390680.693362:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390680.693409:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390680.693446:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390680.693480:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390680.693556:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893120 00000100:00100000:3.0:1788390680.693567:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893120 00000100:00100000:3.0:1788390680.693647:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893376 00000100:00100000:3.0:1788390680.693663:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893376 00000100:00100000:3.0:1788390680.693695:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1788390680.693706:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093893120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390680.693782:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093893120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390680.693790:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1788390680.693809:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1788390680.693816:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093893376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390680.693841:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093893376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390680.693847:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:0.0:1788390680.694244:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893248 00000100:00100000:0.0:1788390680.694250:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893248 00000100:00080000:1.0:1788390680.694292:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390680.694298:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390680.694300:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:0.0:1788390680.694311:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093893248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390680.694351:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093893248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390680.694358:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788390680.694513:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093892992 00000100:00100000:2.0:1788390680.694518:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093892992 00000100:00100000:2.0:1788390680.694562:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:2.0:1788390680.694570:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093892992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390680.694619:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093892992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390680.694626:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00010000:00010000:0.0:1788390681.677094:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390681.835493:0:21815:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390681.835503:0:21815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390681.836791:0:21815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390681.836806:0:21815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1788390682.445220:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390682.445231:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390682.445781:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390682.445795:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390682.701165:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390683.086597:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103303552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.086684:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.086739:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103304064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.086770:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.086798:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390683.086804:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103303936:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.086829:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.086858:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103303680:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.086886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.086920:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103304192:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.086943:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.087133:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390683.087152:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103303808:0@lo:400:kworker.0 00000100:00100000:3.0:1788390683.087177:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390683.087197:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103304320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390683.087221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390683.087426:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304320 00000100:00100000:0.0:1788390683.087434:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304320 00000100:00100000:0.0:1788390683.087488:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788390683.087497:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103304320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390683.087527:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390683.087569:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103304320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390683.087576:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788390683.087598:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303680 00000100:00100000:0.0:1788390683.087602:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303680 00000100:00100000:0.0:1788390683.087626:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303808 00000100:00100000:0.0:1788390683.087629:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303808 00000100:00100000:0.0:1788390683.087645:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390683.087651:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103303680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390683.087680:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103303680:12345-0@lo:400:kworker.0 Request processed in 29us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390683.087686:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390683.087697:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390683.087703:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103303808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390683.087726:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103303808:12345-0@lo:400:kworker.0 Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390683.087731:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788390683.087781:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390683.087786:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390683.087857:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303552 00000100:00100000:1.0:1788390683.087862:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303552 00000100:00100000:1.0:1788390683.087893:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788390683.087900:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103303552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.087937:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103303552:12345-0@lo:400:kworker.0 Request processed in 38us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390683.087943:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788390683.088051:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103303808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.088066:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103304320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390683.088075:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103303680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.088112:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103303552:0@lo:400:kworker.0 00000100:00100000:2.0:1788390683.089015:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304064 00000100:00100000:2.0:1788390683.089029:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304064 00000100:00100000:2.0:1788390683.089073:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103303936 00000100:00100000:2.0:1788390683.089075:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103303936 00000100:00080000:1.0:1788390683.089076:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390683.089089:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304192 00000100:00100000:2.0:1788390683.089092:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304192 00000100:00100000:1.0:1788390683.089107:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788390683.089119:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103304064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390683.089125:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788390683.089146:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.089183:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103304064:12345-0@lo:400:kworker.0 Request processed in 67us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390683.089190:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103303936:12345-0@lo:400:kworker.0 Request processed in 57us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390683.089192:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788390683.089200:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788390683.089216:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788390683.089224:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.089256:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103304192:12345-0@lo:400:kworker.0 Request processed in 33us (2312us total) trans 0 rc 0/0 00000100:00080000:0.0:1788390683.089528:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390683.089554:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103303936:0@lo:400:kworker.0 00000100:00100000:0.0:1788390683.089565:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103304064:0@lo:400:kworker.0 00000100:00100000:0.0:1788390683.089599:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103304192:0@lo:400:kworker.0 00000100:00100000:1.0:1788390683.091465:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000040:00080000:1.0:1788390683.353522:0:21866:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390683.353611:0:21866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390683.354419:0:21866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390683.354431:0:21866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390683.725231:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390684.749186:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390684.872456:0:21917:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390684.872466:0:21917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390684.874413:0:21917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390684.874427:0:21917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390685.645500:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390685.645528:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103304448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390685.645613:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390685.646623:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304448 00000100:00100000:0.0:1788390685.646633:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304448 00000100:00100000:0.0:1788390685.646988:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788390685.647001:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103304448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390685.647038:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390685.647104:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103304448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390685.647309:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103304448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390685.647415:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788390685.647629:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390685.773286:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390685.818189:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390685.818266:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390685.818474:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390685.818558:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893504 00000100:00100000:3.0:1788390685.818568:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893504 00000100:00100000:3.0:1788390685.818624:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:3.0:1788390685.818632:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093893504:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390685.818691:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093893504:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390685.818697:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:1.0:1788390685.819080:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390685.819097:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893632 00000100:00100000:0.0:1788390685.819103:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893632 00000100:00100000:3.0:1788390685.819133:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893888 00000100:00100000:3.0:1788390685.819138:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893888 00000100:00100000:3.0:1788390685.819242:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1788390685.819251:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093893888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390685.819263:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093893760 00000100:00100000:2.0:1788390685.819269:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093893760 00000100:00100000:2.0:1788390685.819310:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:2.0:1788390685.819318:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093893760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390685.819426:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093893888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 175us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390685.819433:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1788390685.819449:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:3.0:1788390685.819456:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093893632:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:1.0:1788390685.819619:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390685.819624:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390685.820930:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093893760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1603us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390685.820942:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788390685.821030:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093893632:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1570us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390685.821039:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000040:00080000:3.0:1788390686.343445:0:21968:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390686.343456:0:21968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390686.344021:0:21968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390686.344032:0:21968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390686.797291:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390687.821165:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390687.878482:0:22019:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390687.878492:0:22019:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390687.878930:0:22019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390687.878937:0:22019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390688.205350:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390688.205375:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103304576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390688.205452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390688.205606:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304576 00000100:00100000:1.0:1788390688.205616:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304576 00000100:00100000:1.0:1788390688.205692:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390688.205703:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103304576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390688.205738:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390688.205788:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103304576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390688.205796:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390688.205859:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103304576:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788390688.206013:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390688.206332:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103305088:0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.206369:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390688.206394:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390688.206400:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103304960:0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.206422:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390688.206462:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305088 00000100:00100000:2.0:1788390688.206466:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305088 00000100:00100000:2.0:1788390688.206504:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304960 00000100:00100000:2.0:1788390688.206507:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304960 00000100:00100000:2.0:1788390688.206528:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788390688.206536:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103305088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.206577:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103305088:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390688.206583:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788390688.206597:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788390688.206602:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103304960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.206627:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103304960:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390688.206633:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1788390688.206653:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390688.206670:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103304960:0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.206679:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103305088:0@lo:400:kworker.0 00000100:00100000:0.0:1788390688.207024:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103304704:0@lo:400:kworker.0 00000100:00100000:0.0:1788390688.207062:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390688.207107:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103305216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390688.207132:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390688.207211:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304704 00000100:00100000:2.0:1788390688.207215:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304704 00000100:00100000:1.0:1788390688.207251:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103304832:0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.207264:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788390688.207284:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103304704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390688.207293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390688.207329:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103304704:12345-0@lo:400:kworker.0 Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390688.207337:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103304832 00000100:00100000:2.0:1788390688.207338:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788390688.207343:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103304832 00000100:00080000:2.0:1788390688.207370:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390688.207387:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788390688.207402:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390688.207455:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103304832:12345-0@lo:400:kworker.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390688.207462:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788390688.207469:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103304704:0@lo:400:kworker.0 00000100:00100000:2.0:1788390688.207595:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103304832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390688.207639:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305216 00000100:00100000:3.0:1788390688.207643:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305216 00000100:00100000:3.0:1788390688.207726:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788390688.207733:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103305216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390688.207782:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103305216:12345-0@lo:400:kworker.0 Request processed in 49us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390688.207788:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788390688.207856:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103305216:0@lo:400:kworker.0 00000100:00080000:2.0:1788390688.208037:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390688.845356:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390689.423512:0:22071:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390689.423523:0:22071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390689.424596:0:22071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390689.424610:0:22071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390689.869218:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390690.765838:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103305344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390690.765917:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390690.766126:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305344 00000100:00100000:1.0:1788390690.766134:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305344 00000100:00100000:1.0:1788390690.766200:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390690.766210:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103305344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390690.766245:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788390690.766290:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390690.767374:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103305344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1160us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390690.767384:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390690.767558:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6912ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103305344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390690.905330:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390690.933458:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390690.933503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390690.933536:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390690.933584:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390690.933614:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894144 00000100:00100000:3.0:1788390690.933624:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894144 00000100:00100000:3.0:1788390690.933692:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894400 00000100:00100000:3.0:1788390690.933696:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894400 00000100:00100000:3.0:1788390690.933722:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1788390690.933732:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093894144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390690.933808:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2357:x1875263093894144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390690.933816:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1788390690.933834:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:3.0:1788390690.933842:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093894400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390690.933867:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2357:x1875263093894400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390690.933874:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00080000:3.0:1788390690.933889:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390690.934077:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894016 00000100:00100000:2.0:1788390690.934082:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894016 00000100:00100000:2.0:1788390690.934112:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:2.0:1788390690.934119:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093894016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390690.934146:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093894016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390690.934153:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1788390690.934738:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894272 00000100:00100000:0.0:1788390690.934745:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894272 00000100:00100000:0.0:1788390690.934797:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788390690.934807:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093894272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390690.934859:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093894272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 54us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390690.934866:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00080000:3.0:1788390690.935352:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788390691.063482:0:22122:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390691.063507:0:22122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390691.064393:0:22122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390691.064403:0:22122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390691.917215:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390692.646682:0:22173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390692.646693:0:22173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390692.648692:0:22173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390692.648710:0:22173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1788390692.685278:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390692.685291:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390692.685818:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390692.685832:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390692.944520:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390693.325214:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103305472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390693.325889:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390693.326949:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305472 00000100:00100000:0.0:1788390693.326988:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305472 00000100:00080000:2.0:1788390693.327059:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390693.327066:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788390693.327079:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103305472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390693.327118:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390693.327288:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103305600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.327338:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103305472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390693.327347:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788390693.327353:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390693.327390:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305600 00000100:00100000:0.0:1788390693.327396:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305600 00000100:00100000:0.0:1788390693.327440:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788390693.327448:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103305600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.327491:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103305600:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390693.327510:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788390693.327721:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103305472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390693.327774:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103305600:0@lo:400:kworker.0 00000100:00100000:3.0:1788390693.327872:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103305728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390693.327907:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390693.327949:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305728 00000100:00100000:2.0:1788390693.327954:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305728 00000100:00100000:2.0:1788390693.328015:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788390693.328024:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103305728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.328035:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103305856:0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.328089:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390693.328153:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305856 00000100:00100000:0.0:1788390693.328157:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305856 00000100:00100000:0.0:1788390693.328184:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788390693.328190:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103305856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.328231:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103305856:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390693.328246:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788390693.328275:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103305856:0@lo:400:kworker.0 00000100:00080000:0.0:1788390693.328303:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390693.328707:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103305728:12345-0@lo:400:kworker.0 Request processed in 683us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390693.328715:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788390693.328742:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103306112:0@lo:400:kworker.0 00000100:00100000:2.0:1788390693.328771:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390693.328804:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103305984:0@lo:400:kworker.0 00000100:00100000:0.0:1788390693.328834:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390693.328876:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306112 00000100:00100000:2.0:1788390693.328880:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306112 00000100:00100000:2.0:1788390693.328920:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103305984 00000100:00100000:2.0:1788390693.328923:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103305984 00000100:00080000:0.0:1788390693.328938:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390693.329101:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788390693.329112:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103306112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390693.329154:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103306112:12345-0@lo:400:kworker.0 Request processed in 45us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390693.329160:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788390693.329175:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788390693.329181:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6912ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103305984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390693.329211:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6912ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103305984:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390693.329216:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788390693.329249:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103305984:0@lo:400:kworker.0 00000100:00100000:3.0:1788390693.329323:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103305728:0@lo:400:kworker.0 00000100:00100000:2.0:1788390693.329353:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103306112:0@lo:400:kworker.0 00010000:00010000:1.0:1788390693.965236:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390694.187623:0:22224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390694.187635:0:22224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390694.188629:0:22224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390694.188644:0:22224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390694.989430:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390695.823877:0:22275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390695.823884:0:22275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390695.828786:0:22275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390695.828802:0:22275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788390695.886912:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390695.886935:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103306240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390695.887040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390695.887205:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306240 00000100:00100000:1.0:1788390695.887220:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306240 00000100:00100000:1.0:1788390695.887321:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390695.887331:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103306240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390695.887367:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390695.887415:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103306240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390695.887422:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390695.887492:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103306240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390695.888840:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390696.014889:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390696.054332:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390696.054383:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390696.054416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390696.054450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390696.054477:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894656 00000100:00100000:1.0:1788390696.054488:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894656 00000100:00100000:3.0:1788390696.054490:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894784 00000100:00100000:3.0:1788390696.054497:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894784 00000100:00100000:2.0:1788390696.054564:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894528 00000100:00100000:2.0:1788390696.054568:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894528 00000100:00100000:1.0:1788390696.054574:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093894912 00000100:00100000:1.0:1788390696.054580:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093894912 00000100:00100000:0.0:1788390696.054641:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1788390696.054653:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093894656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390696.054718:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093894656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390696.054723:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:2.0:1788390696.054786:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:2.0:1788390696.054793:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093894528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390696.054812:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093894528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390696.054817:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1788390696.055402:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:1.0:1788390696.055413:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093894912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390696.055462:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093894912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390696.055470:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1788390696.057081:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390696.057094:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093894784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390696.057172:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093894784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390696.057179:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00080000:2.0:1788390696.057737:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390696.057746:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390697.037138:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390697.383663:0:22327:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390697.383673:0:22327:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390697.384271:0:22327:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390697.384279:0:22327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390698.061386:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390698.445167:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390698.445188:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103306752:0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445249:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103306624:0@lo:400:kworker.0 00000100:00100000:1.0:1788390698.445253:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390698.445323:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103306880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390698.445405:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103307136:0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445430:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390698.445450:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390698.445455:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103306368:0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445482:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390698.445503:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103307008:0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445539:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390698.445623:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306752 00000100:00100000:2.0:1788390698.445632:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306752 00000100:00100000:3.0:1788390698.445645:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306624 00000100:00100000:3.0:1788390698.445651:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306624 00000100:00100000:3.0:1788390698.445702:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390698.445710:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103306624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445758:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103306624:12345-0@lo:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390698.445764:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390698.445789:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307136 00000100:00100000:3.0:1788390698.445793:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307136 00000100:00100000:3.0:1788390698.445818:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307008 00000100:00100000:3.0:1788390698.445821:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307008 00000100:00100000:3.0:1788390698.445838:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788390698.445844:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103307136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445874:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103307136:12345-0@lo:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390698.445880:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788390698.445893:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788390698.445898:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103307008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.445924:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103307008:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390698.445929:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788390698.445947:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306368 00000100:00100000:3.0:1788390698.445950:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306368 00000100:00100000:3.0:1788390698.446008:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788390698.446017:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103306368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390698.446031:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788390698.446044:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103306752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390698.446051:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103306368:12345-0@lo:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390698.446064:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788390698.446093:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103306752:12345-0@lo:400:kworker.0 Request processed in 53us (841us total) trans 0 rc 0/0 00000100:00080000:3.0:1788390698.446099:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390698.446103:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788390698.446105:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390698.446109:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390698.446160:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103306368:0@lo:400:kworker.0 00000100:00100000:2.0:1788390698.446175:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103307008:0@lo:400:kworker.0 00000100:00100000:2.0:1788390698.446185:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103306624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390698.446194:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103307136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390698.446271:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103306752:0@lo:400:kworker.0 00000100:00100000:1.0:1788390698.446279:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103306496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390698.446301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390698.446520:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306496 00000100:00100000:2.0:1788390698.446525:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306496 00000100:00100000:2.0:1788390698.446562:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390698.446570:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103306496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390698.446599:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390698.446634:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103306496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390698.446640:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390698.447073:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103306496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390698.447174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390698.447334:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103306880 00000100:00100000:1.0:1788390698.447339:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103306880 00000100:00100000:1.0:1788390698.447375:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788390698.447383:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103306880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390698.447436:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103306880:12345-0@lo:400:kworker.0 Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390698.447443:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788390698.447479:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103306880:0@lo:400:kworker.0 00000040:00080000:2.0:1788390698.862765:0:22378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390698.862775:0:22378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390698.864111:0:22378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390698.864121:0:22378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390699.085114:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390700.110082:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390700.401425:0:22429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390700.401435:0:22429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390700.402945:0:22429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390700.402975:0:22429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390701.006421:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390701.006447:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103307264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390701.006605:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390701.006828:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307264 00000100:00100000:1.0:1788390701.006838:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307264 00000100:00100000:1.0:1788390701.007027:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788390701.007038:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103307264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390701.007075:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390701.007125:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103307264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390701.007132:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390701.007227:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103307264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390701.007447:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390701.133995:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390701.173127:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390701.173173:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390701.173192:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895040 00000100:00100000:2.0:1788390701.173203:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895040 00000100:00100000:2.0:1788390701.173253:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1788390701.173264:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093895040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390701.173291:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390701.173331:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093895040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390701.173338:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:3.0:1788390701.173580:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895168 00000100:00100000:3.0:1788390701.173586:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895168 00000100:00080000:2.0:1788390701.173645:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390701.173673:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:3.0:1788390701.173682:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093895168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390701.173730:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093895168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390701.173736:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:2.0:1788390701.173843:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390701.174217:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895424 00000100:00100000:3.0:1788390701.174222:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895424 00000100:00080000:2.0:1788390701.174285:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390701.174662:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:3.0:1788390701.174673:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093895424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390701.174734:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093895424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 63us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390701.174741:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:1.0:1788390701.175045:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895296 00000100:00100000:1.0:1788390701.175050:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895296 00000100:00100000:1.0:1788390701.175085:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:1.0:1788390701.175090:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093895296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390701.175115:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093895296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390701.175121:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00080000:2.0:1788390701.175370:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788390702.034453:0:22480:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390702.034466:0:22480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390702.035058:0:22480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390702.035069:0:22480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390702.158866:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390702.925325:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390702.925338:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390702.926107:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390702.926125:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390703.183503:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390703.565183:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390703.565215:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103307392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390703.565307:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390703.565399:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307392 00000100:00100000:1.0:1788390703.565408:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307392 00000100:00100000:1.0:1788390703.565485:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788390703.565498:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103307392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390703.565545:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390703.565612:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103307392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390703.565621:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788390703.565646:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390703.565695:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103307392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390703.569256:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103307648:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569346:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390703.569406:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390703.569426:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103307520:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569463:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390703.569487:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103308032:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569515:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390703.569551:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307648 00000100:00100000:3.0:1788390703.569560:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307648 00000100:00100000:3.0:1788390703.569630:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788390703.569642:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103307648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569702:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103307648:12345-0@lo:400:kworker.0 Request processed in 62us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390703.569710:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788390703.569741:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307520 00000100:00100000:3.0:1788390703.569745:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307520 00000100:00100000:3.0:1788390703.569773:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788390703.569781:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103307520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569814:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3289:x1875263103307520:12345-0@lo:400:kworker.0 Request processed in 34us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390703.569821:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788390703.569851:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308032 00000100:00100000:3.0:1788390703.569855:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308032 00000100:00100000:3.0:1788390703.569886:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788390703.569893:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103308032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.569923:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103308032:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390703.569929:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788390703.570004:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103307904:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390703.570068:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390703.570075:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103307776:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570097:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390703.570123:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307904 00000100:00100000:3.0:1788390703.570127:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307904 00000100:00100000:3.0:1788390703.570150:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103307776 00000100:00100000:3.0:1788390703.570154:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103307776 00000100:00100000:3.0:1788390703.570175:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788390703.570181:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103307904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570217:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103307904:12345-0@lo:400:kworker.0 Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390703.570224:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788390703.570237:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788390703.570243:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103307776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570274:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103307776:12345-0@lo:400:kworker.0 Request processed in 30us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390703.570279:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1788390703.570306:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390703.570311:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390703.570345:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103307776:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570356:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103307904:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570391:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6ebd9ca6-c84c-470c-bc70-726259965b52:3289:1875263103307520:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570402:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103308032:0@lo:400:kworker.0 00000100:00100000:3.0:1788390703.570413:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103307648:0@lo:400:kworker.0 00000040:00080000:1.0:1788390703.962393:0:22532:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390703.962406:0:22532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390703.963246:0:22532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390703.963261:0:22532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390704.205561:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390705.230413:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390705.804148:0:22583:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390705.804161:0:22583:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390705.804688:0:22583:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390705.804703:0:22583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390706.126498:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103308160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390706.126603:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390706.127359:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308160 00000100:00100000:1.0:1788390706.127371:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308160 00000100:00100000:1.0:1788390706.127453:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788390706.127464:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103308160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390706.127513:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390706.127634:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103308160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390706.127642:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788390706.127894:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390706.129847:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103308160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390706.255868:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390706.294644:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390706.294699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390706.294743:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390706.294846:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895552 00000100:00100000:0.0:1788390706.294858:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895552 00000100:00100000:0.0:1788390706.294941:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1788390706.294953:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093895552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390706.295058:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2357:x1875263093895552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390706.295066:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:3.0:1788390706.295449:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895680 00000100:00100000:3.0:1788390706.295454:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895680 00000100:00100000:3.0:1788390706.295510:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895936 00000100:00100000:3.0:1788390706.295514:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895936 00000100:00100000:3.0:1788390706.295538:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788390706.295546:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093895680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390706.295592:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093895680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 47us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390706.295600:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788390706.295614:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:3.0:1788390706.295621:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093895936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390706.295720:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093895936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390706.295728:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:3.0:1788390706.295769:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390706.295846:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093895808 00000100:00100000:3.0:1788390706.295850:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093895808 00000100:00100000:3.0:1788390706.295881:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788390706.295887:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093895808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390706.296014:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c81d4476-fbab-45da-be95-db71a881e268+6:2357:x1875263093895808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390706.296021:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00080000:2.0:1788390706.296126:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390706.296140:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788390707.277299:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390707.504157:0:22634:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390707.504170:0:22634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390707.504724:0:22634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390707.504743:0:22634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390708.301238:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390708.685339:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103308288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685445:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685503:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103308800:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685565:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788390708.685571:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103308416:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685600:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685617:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103308928:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685639:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685671:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103308544:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685694:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685713:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390708.685718:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103308672:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.685744:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390708.685793:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308288 00000100:00100000:3.0:1788390708.685802:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308288 00000100:00100000:2.0:1788390708.685988:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308800 00000100:00100000:2.0:1788390708.685993:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308800 00000100:00100000:2.0:1788390708.686057:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308928 00000100:00100000:2.0:1788390708.686079:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308928 00000100:00100000:2.0:1788390708.686104:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308672 00000100:00100000:2.0:1788390708.686107:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308672 00000100:00100000:2.0:1788390708.686124:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788390708.686135:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686203:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103308800:12345-0@lo:400:kworker.0 Request processed in 70us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390708.686211:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788390708.686231:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788390708.686236:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686263:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103308928:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390708.686268:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788390708.686277:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788390708.686283:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103308672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686311:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103308672:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390708.686316:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788390708.686337:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308416 00000100:00100000:2.0:1788390708.686340:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308416 00000100:00100000:2.0:1788390708.686365:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103308544 00000100:00100000:2.0:1788390708.686368:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103308544 00000100:00100000:2.0:1788390708.686388:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390708.686394:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686427:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103308416:12345-0@lo:400:kworker.0 Request processed in 33us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390708.686433:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390708.686453:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788390708.686459:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103308544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686493:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103308544:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390708.686498:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788390708.686519:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390708.686524:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390708.686526:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390708.686585:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686598:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103308544:0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686637:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686647:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103308928:0@lo:400:kworker.0 00000100:00100000:2.0:1788390708.686657:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103308800:0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.688499:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788390708.688512:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103308288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390708.688605:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6868d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3286:x1875263103308288:12345-0@lo:400:kworker.0 Request processed in 94us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390708.688613:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788390708.688758:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6ebd9ca6-c84c-470c-bc70-726259965b52:3286:1875263103308288:0@lo:400:kworker.0 00000100:00100000:0.0:1788390708.688983:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390708.688998:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103309056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390708.689037:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390708.689073:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309056 00000100:00100000:0.0:1788390708.689080:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309056 00000100:00100000:0.0:1788390708.689110:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788390708.689116:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103309056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390708.689150:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390708.689182:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103309056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390708.689194:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788390708.689227:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103309056:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788390709.245734:0:22685:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390709.245746:0:22685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390709.246303:0:22685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390709.246313:0:22685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390709.327202:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390710.349245:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390710.706672:0:22737:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390710.706686:0:22737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390710.707380:0:22737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390710.707389:0:22737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390711.245267:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103309184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390711.245358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390711.245479:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309184 00000100:00100000:1.0:1788390711.245489:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309184 00000100:00080000:3.0:1788390711.245547:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390711.245563:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390711.245575:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103309184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390711.245610:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390711.248911:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103309184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390711.249003:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103309184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3428us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390711.249073:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1788390711.374005:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390711.413186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390711.413299:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390711.413653:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390711.413695:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390711.413741:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896192 00000100:00100000:3.0:1788390711.413752:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896192 00000100:00100000:0.0:1788390711.413861:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896448 00000100:00100000:0.0:1788390711.413866:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896448 00000100:00100000:0.0:1788390711.413930:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1788390711.413943:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093896448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390711.414041:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2359:x1875263093896448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390711.414048:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00080000:0.0:1788390711.414159:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390711.414232:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896320 00000100:00100000:1.0:1788390711.414237:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896320 00000100:00100000:1.0:1788390711.414280:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1788390711.414288:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093896320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390711.414322:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c81d4476-fbab-45da-be95-db71a881e268+6:2359:x1875263093896320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390711.414340:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00080000:0.0:1788390711.414517:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390711.414705:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1788390711.414714:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093896192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390711.414759:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c81d4476-fbab-45da-be95-db71a881e268+14:2359:x1875263093896192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390711.414766:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:2.0:1788390711.416560:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896064 00000100:00100000:2.0:1788390711.416572:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896064 00000100:00100000:2.0:1788390711.416623:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1788390711.416635:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093896064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390711.416742:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2359:x1875263093896064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 111us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390711.416750:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000040:00080000:0.0:1788390712.143231:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390712.143244:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390712.143822:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788390712.143833:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788390712.355742:0:22788:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390712.355756:0:22788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390712.356991:0:22788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390712.357011:0:22788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788390712.398238:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390713.421348:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390713.805221:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103309440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805290:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805336:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103309952:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805361:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805382:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788390713.805388:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103309312:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805437:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103309824:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805457:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805483:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103309568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805504:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805518:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390713.805523:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103309696:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.805561:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390713.805589:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309952 00000100:00100000:3.0:1788390713.805597:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309952 00000100:00100000:3.0:1788390713.805646:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309824 00000100:00100000:3.0:1788390713.805649:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309824 00000100:00100000:3.0:1788390713.805665:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309696 00000100:00100000:3.0:1788390713.805667:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309696 00000100:00100000:3.0:1788390713.805682:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788390713.805690:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103309952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390713.805807:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309312 00000100:00100000:1.0:1788390713.805811:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309312 00000100:00100000:1.0:1788390713.805839:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788390713.805847:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103309312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390713.805910:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103309312:12345-0@lo:400:kworker.0 Request processed in 63us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390713.805917:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788390713.805997:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103309312:0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806136:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309440 00000100:00100000:2.0:1788390713.806141:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309440 00000100:00100000:2.0:1788390713.806176:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103309568 00000100:00100000:2.0:1788390713.806179:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103309568 00000100:00100000:2.0:1788390713.806203:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788390713.806210:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103309440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806250:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103309440:12345-0@lo:400:kworker.0 Request processed in 41us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390713.806257:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788390713.806269:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390713.806276:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103309568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806307:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103309568:12345-0@lo:400:kworker.0 Request processed in 32us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390713.806312:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390713.806339:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788390713.806347:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103309824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806375:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103309824:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390713.806381:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788390713.806395:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788390713.806402:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103309696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806430:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103309696:12345-0@lo:400:kworker.0 Request processed in 29us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390713.806435:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788390713.806506:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103309696:0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806517:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103309568:0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806540:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103309824:0@lo:400:kworker.0 00000100:00100000:2.0:1788390713.806549:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6a0f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103309440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390713.806674:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103309952:12345-0@lo:400:kworker.0 Request processed in 984us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390713.806682:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1788390713.806704:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390713.806809:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390713.806813:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390713.806999:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103309952:0@lo:400:kworker.0 00000100:00100000:1.0:1788390713.810158:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390713.810186:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103310080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390713.810254:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390713.810299:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310080 00000100:00100000:1.0:1788390713.810306:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310080 00000100:00100000:1.0:1788390713.810349:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390713.810358:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103310080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390713.810391:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390713.810436:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103310080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390713.810443:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390713.810491:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103310080:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788390714.036453:0:22839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390714.036463:0:22839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390714.037056:0:22839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390714.037065:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788390714.447303:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390715.469052:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390715.736239:0:22890:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390715.736250:0:22890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390715.737052:0:22890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390715.737063:0:22890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390716.365210:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390716.365577:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103310208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390716.365636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390716.365771:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310208 00000100:00100000:1.0:1788390716.365781:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310208 00000100:00080000:3.0:1788390716.365814:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390716.365854:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788390716.365865:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103310208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390716.365900:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390716.365982:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103310208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390716.365989:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390716.366054:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103310208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390716.493546:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390716.534084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390716.534133:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390716.534288:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390716.534328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390716.534357:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896832 00000100:00100000:0.0:1788390716.534366:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896832 00000100:00100000:0.0:1788390716.534427:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788390716.534436:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093896832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390716.534502:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2358:x1875263093896832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390716.534510:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00080000:0.0:1788390716.534654:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390716.534931:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896576 00000100:00100000:1.0:1788390716.534936:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896576 00000100:00100000:1.0:1788390716.534995:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788390716.535003:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093896576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390716.535040:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2358:x1875263093896576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390716.535047:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:3.0:1788390716.535668:0:16577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896704 00000100:00100000:3.0:1788390716.535675:0:16577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896704 00000100:00100000:2.0:1788390716.535819:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093896960 00000100:00100000:2.0:1788390716.535824:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093896960 00000100:00100000:2.0:1788390716.535919:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:2.0:1788390716.535928:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093896960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390716.535998:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2358:x1875263093896960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390716.536005:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00080000:1.0:1788390716.536796:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390716.537027:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:3.0:1788390716.537037:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093896704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390716.537093:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2358:x1875263093896704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390716.537111:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000040:00080000:2.0:1788390717.480624:0:22942:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390717.480634:0:22942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390717.481806:0:22942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390717.481818:0:22942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390717.526655:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390718.541211:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390718.925194:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390718.925297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390718.925394:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310336 00000100:00100000:1.0:1788390718.925403:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310336 00000100:00100000:1.0:1788390718.925472:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788390718.925483:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103310336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390718.925527:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390718.925579:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103310336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390718.925587:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788390718.925611:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390718.925657:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390718.927233:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103310464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927301:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390718.927403:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310464 00000100:00100000:3.0:1788390718.927422:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390718.927428:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103310848:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390718.927485:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103310592:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927564:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390718.927596:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390718.927603:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103310720:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927627:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390718.927658:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310848 00000100:00100000:3.0:1788390718.927665:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310848 00000100:00100000:3.0:1788390718.927727:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310720 00000100:00100000:3.0:1788390718.927730:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310720 00000100:00100000:3.0:1788390718.927751:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788390718.927760:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103310848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927828:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103310848:12345-0@lo:400:kworker.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390718.927836:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788390718.927854:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788390718.927860:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103310720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.927897:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103310720:12345-0@lo:400:kworker.0 Request processed in 37us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390718.927903:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1788390718.927955:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390718.928019:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103310720:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.928051:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103310848:0@lo:400:kworker.0 00000100:00100000:0.0:1788390718.929879:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310592 00000100:00100000:0.0:1788390718.929895:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310592 00000100:00100000:0.0:1788390718.930010:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788390718.930026:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103310592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390718.930132:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103310592:12345-0@lo:400:kworker.0 Request processed in 113us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390718.930139:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788390718.930224:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310464 00000100:00100000:1.0:1788390718.930275:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788390718.930283:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103310464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788390718.930306:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390718.930328:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3287:x1875263103310464:12345-0@lo:400:kworker.0 Request processed in 46us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390718.930348:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788390718.930351:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103310592:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.930389:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6ebd9ca6-c84c-470c-bc70-726259965b52:3287:1875263103310464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.930560:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103310976:0@lo:400:kworker.0 00000100:00100000:3.0:1788390718.930602:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390718.930651:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103310976 00000100:00100000:0.0:1788390718.930656:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103310976 00000100:00100000:0.0:1788390718.930694:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788390718.930700:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103310976:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788390718.931723:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390718.934844:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103310976:12345-0@lo:400:kworker.0 Request processed in 4128us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390718.934863:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788390718.934893:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103310976:0@lo:400:kworker.0 00000040:00080000:1.0:1788390719.251882:0:22993:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788390719.251897:0:22993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390719.252445:0:22993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788390719.252457:0:22993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788390719.568832:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390720.589663:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390721.021838:0:23044:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390721.021846:0:23044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390721.022359:0:23044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788390721.022367:0:23044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390721.485278:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103311104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390721.485390:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390721.485553:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311104 00000100:00100000:1.0:1788390721.485565:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311104 00000100:00100000:1.0:1788390721.485729:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788390721.485742:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103311104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390721.485818:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390721.485885:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103311104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390721.485896:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390721.485992:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103311104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390721.486178:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390721.617353:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390721.654401:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390721.654484:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390721.654586:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390721.654626:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390721.654665:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093897344 00000100:00100000:1.0:1788390721.654678:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093897344 00000100:00100000:1.0:1788390721.654767:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788390721.654779:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093897344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390721.654882:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c81d4476-fbab-45da-be95-db71a881e268+6:2356:x1875263093897344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390721.654891:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00080000:1.0:1788390721.655053:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390721.655364:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093897088 00000100:00100000:0.0:1788390721.655370:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093897088 00000100:00100000:0.0:1788390721.655418:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1788390721.655428:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093897088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390721.655477:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8b7dfed-d8c1-45b7-a8e7-c2e217de6eed+13:2356:x1875263093897088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390721.655484:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788390721.655821:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093897216 00000100:00100000:3.0:1788390721.655827:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093897216 00000100:00100000:3.0:1788390721.655925:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093897472 00000100:00100000:3.0:1788390721.655929:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093897472 00000100:00100000:0.0:1788390721.655988:0:16577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1788390721.655998:0:16577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093897216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390721.656046:0:16577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c81d4476-fbab-45da-be95-db71a881e268+14:2356:x1875263093897216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390721.656067:0:16577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00080000:1.0:1788390721.656496:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390721.656944:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:3.0:1788390721.656955:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093897472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390721.657031:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fca61cce-adf5-4b9d-82ab-6877bfc57d88+6:2356:x1875263093897472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390721.657038:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000040:00080000:3.0:1788390722.381651:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390722.381665:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390722.382246:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788390722.382261:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788390722.637389:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390723.430904:0:23094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: request on 0x200000bd1:0x4:0x0 is not SUCCEED on mds1 00010000:00010000:1.0:1788390723.661228:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390724.045294:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103311360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390724.045379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390724.045405:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311360 00000100:00100000:0.0:1788390724.045414:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311360 00000100:00100000:0.0:1788390724.045480:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390724.045491:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103311360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045518:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103311616:0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390724.045596:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103311360:12345-0@lo:400:kworker.0 Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.045607:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390724.045638:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311616 00000100:00100000:0.0:1788390724.045642:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311616 00000100:00100000:2.0:1788390724.045651:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788390724.045659:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103311232:0@lo:400:kworker.0 00000100:00100000:0.0:1788390724.045679:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788390724.045688:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103311616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045704:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390724.045733:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103311744:0@lo:400:kworker.0 00000100:00100000:0.0:1788390724.045738:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103311616:12345-0@lo:400:kworker.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.045762:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788390724.045773:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390724.045790:0:16997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311744 00000100:00100000:0.0:1788390724.045795:0:16997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311744 00000100:00100000:2.0:1788390724.045812:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103311616:0@lo:400:kworker.0 00000100:00100000:0.0:1788390724.045832:0:16997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788390724.045841:0:16997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103311744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045860:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311232 00000100:00100000:2.0:1788390724.045865:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311232 00000100:00100000:0.0:1788390724.045882:0:16997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103311744:12345-0@lo:400:kworker.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.045890:0:16997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788390724.045896:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788390724.045905:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103311232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390724.045927:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103311744:0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045956:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ebd9ca6-c84c-470c-bc70-726259965b52+19:3288:x1875263103311232:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.045984:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6ebd9ca6-c84c-470c-bc70-726259965b52:3288:1875263103311232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.045985:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1788390724.046033:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390724.046049:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390724.046152:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103311360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390724.046159:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103311872:0@lo:400:kworker.0 00000100:00100000:1.0:1788390724.046182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390724.046221:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788390724.046227:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103311488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390724.046248:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390724.046270:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103312000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390724.046292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390724.046442:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311488 00000100:00100000:0.0:1788390724.046447:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311488 00000100:00100000:0.0:1788390724.046484:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788390724.046491:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103311488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390724.046525:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103311872 00000100:00100000:2.0:1788390724.046531:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103311872 00000100:00100000:0.0:1788390724.046532:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103311488:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.046542:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788390724.046567:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788390724.046575:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103311872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390724.046585:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103312000 00000100:00100000:0.0:1788390724.046590:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103312000 00000100:00100000:2.0:1788390724.046613:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103311872:12345-0@lo:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390724.046620:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788390724.046625:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788390724.046633:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103312000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390724.046661:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390724.046694:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103312000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (401us total) trans 0 rc 0/0 00000100:00080000:1.0:1788390724.046709:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390724.046710:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788390724.046714:0:14350:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390724.046738:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103311488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390724.046754:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103312000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390724.046762:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103311872:0@lo:400:kworker.0 00010000:00010000:0.0:1788390724.687431:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 35408 lines, 35408 kept, 0 dropped, 0 bad.